Exporting analog raw data CSV only shows up to 0.001

Hi I’m wondering if it’s possible to export analog raw data CSV at a smaller resolution ?
Eg. 0.00001

Currently it seems restricted to 0.001 and it’s a little lacking for me

The Logic Pro devices have a 12 bit ADC over [-10 to +10] V (20 V range):

2^12 = 4096 counts (LSBs) of resolution

20V/(4096 counts) = 0.0048828125 V/count resolution.

The Logic 8 has a 10-bit ADC over [0 to 5] V, or 1/4th the ADC bits and 1/4th the range, so effectively the same resolution:

5V/(2^10 = 1024 counts) = 0.0048828125 V/count

Thus, 0.001 V (1 mV) is providing more resolution than the underlying hardware capability (~5 mV/count ADC resolution), so I think your real limitation is the hardware itself.

With some internal signal software filtering, the Logic 2 code might derive some additional ‘soft’ resolution, but it isn’t as ‘real’ as what the analog circuitry can actually do (i.e., the ‘hard’ resolution limits of the device).

Finally, you may have noticed in your screenshot how the minimum voltage change/step size is ~5 mV, which is consistent with the info above.

Note: you could export as binary format to see the ‘full’ floating-point number, which is (I think) a single-precision floating-point IEE754 binary32 value (or ‘float’ in C/C++). However, extracting this value won’t change the reality of what the hardware can actually do.

1 Like

Cool! This is now clear to me, thanks a lot.