Skip to the content

The data · what the engine reads

Sixty-six contracts on sixty-five files, eighteen years of one-minute bars, and every line we threw out.

The engine runs on FirstRate Data's one-minute continuous futures files, unadjusted: each file steps from one contract to the next on its roll date, and the step is in the prices as it happened, so a level carried across a roll (yesterday’s close, a 200-day average) carries the roll’s gap with it. Before a contract is offered, the loader reads every line and refuses any it cannot trust: a bar whose high sits below its close, a minute with zero volume. Those lines are excluded and counted, never repaired. Across the sixty-five files the loader refused 23,472 lines of about 210.6 million: 22,771 zero-volume bars and 701 rows whose open, high, low and close do not fit together, about one line in nine thousand. The table is what the loader reported on November 2, 2026, on FirstRate’s download of November 1 (every file to October 30, 2026; every bar to August 14 that August’s download had is there, the same, line for line; on 14 markets it starts with the Sunday evening before August’s first day (M2K, MES, MNQ, B, NG, QG, GC, TN, UB, XC, ZM, ZO, ZR, ZS); on 6 more it has bars before August 14 that August’s didn’t (VX 117, VXM 83, LBS 3, BTC 22, MBT 266, MET 37; VXM, MBT and MET starting with the Sunday evening before, too)); the same facts print on every report, computed again from the file at run time.

Three columns need a word. Span is the first and last bar in the file; a history under ten years carries a printed caution on the report. Excluded is the count of lines the loader refused, by kind: almost all are bars the vendor wrote with zero volume for minutes with no trades, 65% of them flat placeholders (open, high, low and close equal) and all but 40 of them dated 2008 to 2011; excluding them is the same as the gap they should have been; a few are rows whose open, high, low and close do not fit together (the OHLC bounds check in the table). Tick and $/point are what the report's dollars are computed with.

Equity Indices

ContractSpanOne-minute barsExcludedTick / $ per point
ES · E-mini S&P 5002008-01-02 to 2026-10-306,590,045none0.25 / $50
EW · E-mini S&P MidCap 4002008-01-02 to 2026-10-302,836,5461 zero-volume bar0.1 / $100
M2K · Micro E-mini Russell 20002019-05-05 to 2026-10-302,473,019none0.1 / $5
MES · Micro E-mini S&P 5002019-05-05 to 2026-10-302,638,353none0.25 / $5
MFS · E-mini MSCI EAFE2009-09-08 to 2026-10-301,924,2394 zero-volume bars0.05 / $50
MME · E-mini MSCI Emerging Mkts2009-09-08 to 2026-10-303,422,3521 zero-volume bar0.05 / $50
MNQ · Micro E-mini Nasdaq-1002019-05-05 to 2026-10-302,626,516none0.25 / $2
NKD · Nikkei 225 (USD)2008-03-05 to 2026-10-303,863,674none5 / $5
NQ · E-mini Nasdaq-1002008-01-02 to 2026-10-306,256,316none0.25 / $20
RTY · E-mini Russell 20002008-01-02 to 2026-10-305,259,521506 zero-volume bars; caution: density steps up from 2018 (about 400 bars a day in 2008, about 1,000 through 2017, about 1,300 since); lookbacks counted in bars span more clock time in the thin years0.1 / $50
VX · VIX Futures2008-08-05 to 2026-10-302,893,5967 zero-volume bars0.05 / $1,000
VXM · Mini VIX Futures2020-08-09 to 2026-10-30656,03333 zero-volume bars0.05 / $100
YM · E-mini Dow2008-01-02 to 2026-10-306,217,7181,148 zero-volume bars1 / $5

Energy

ContractSpanOne-minute barsExcludedTick / $ per point
B · Brent Crude (ICE)2008-02-24 to 2026-10-305,345,832262 zero-volume bars0.01 / $1,000
BZ · Brent Crude (CME)2008-02-25 to 2026-10-302,770,586none0.01 / $1,000
CL · Crude Oil WTI2008-01-02 to 2026-10-306,472,039287 zero-volume bars0.01 / $1,000
HH · Natural Gas Last-Day2010-08-30 to 2026-10-30246,970none0.001 / $10,000
HO · NY Harbor ULSD (Heating Oil)2008-02-19 to 2026-10-303,070,640186 zero-volume bars0.0001 / $42,000
MCL · Micro WTI Crude2021-07-11 to 2026-10-301,833,662none0.01 / $100
NG · Natural Gas Henry Hub2008-02-24 to 2026-10-305,179,649472 zero-volume bars0.001 / $10,000
QG · E-mini Natural Gas2008-02-24 to 2026-10-302,174,728191 zero-volume bars0.005 / $2,500
RB · RBOB Gasoline2008-02-10 to 2026-10-302,861,615136 zero-volume bars0.0001 / $42,000

Metals

ContractSpanOne-minute barsExcludedTick / $ per point
GC · Gold2008-01-27 to 2026-10-306,564,488960 zero-volume bars0.1 / $100
HG · Copper2008-01-02 to 2026-10-305,788,467637 zero-volume bars0.0005 / $25,000
MGC · Micro Gold2010-10-03 to 2026-10-303,420,764none0.1 / $10
PL · Platinum2008-01-02 to 2026-10-304,382,183230 zero-volume bars0.1 / $50
SI · Silver2008-01-02 to 2026-10-305,974,494641 zero-volume bars0.005 / $5,000
SIL · Micro Silver (1,000 oz)2013-06-24 to 2026-10-302,195,056none0.005 / $1,000

Rates

ContractSpanOne-minute barsExcludedTick / $ per point
TN · Ultra 10-Year T-Note2016-01-10 to 2026-10-302,649,728none0.015625 / $1,000
UB · Ultra T-Bond2010-01-10 to 2026-10-304,091,977none0.03125 / $1,000
US · 30-Year T-Bond2008-01-02 to 2026-10-305,550,995none0.03125 / $1,000
ZF · 5-Year T-Note2008-01-02 to 2026-10-305,487,0231 row failing the OHLC bounds check0.0078125 / $1,000
ZN · 10-Year T-Note2008-01-02 to 2026-10-305,681,9273 rows failing the OHLC bounds check0.015625 / $1,000
ZT · 2-Year T-Note2008-01-02 to 2026-10-303,926,719none0.0078125 / $2,000

Currencies

ContractSpanOne-minute barsExcludedTick / $ per point
A6 · Australian Dollar2008-01-02 to 2026-10-306,258,7761 zero-volume bar0.00005 / $100,000
B6 · British Pound2008-01-02 to 2026-10-306,000,6641 zero-volume bar0.0001 / $62,500
BR · Brazilian Real2008-02-28 to 2026-10-30341,944none0.00005 / $100,000
DX · US Dollar Index (ICE)2008-01-02 to 2026-10-304,695,444987 zero-volume bars0.005 / $1,000
E6 · Euro FX2008-01-02 to 2026-10-306,486,9261 row failing the OHLC bounds check0.00005 / $125,000
E7 · E-mini Euro FX2008-01-02 to 2026-10-303,746,642none0.0001 / $62,500
J1 · Japanese Yen2008-01-02 to 2026-10-306,406,939none0.0000005 / $12,500,000
J7 · E-mini Japanese Yen2008-01-02 to 2026-10-301,164,881none0.000001 / $6,250,000
MP · Mexican Peso2008-01-02 to 2026-10-303,869,6723 zero-volume bars0.00001 / $500,000

Agriculture

ContractSpanOne-minute barsExcludedTick / $ per point
CC · Cocoa2008-02-04 to 2026-10-302,091,857289 zero-volume bars1 / $10
CT · Cotton2008-02-25 to 2026-10-301,990,23730 zero-volume bars0.01 / $500
DC · Class III Milk2008-01-02 to 2026-10-30303,3141 zero-volume bar0.01 / $2,000
GF · Feeder Cattle2008-01-10 to 2026-10-301,094,728none0.025 / $500
HE · Lean Hogs2008-01-18 to 2026-10-301,388,635none0.025 / $400
KC · Coffee2008-01-02 to 2026-10-302,330,227337 zero-volume bars0.05 / $375
KE · KC Hard Red Wheat2008-02-24 to 2026-10-302,109,8333,006 zero-volume bars0.25 / $50
LBS · Lumber (Random Length, to May 15, 2023)2008-10-20 to 2023-05-15 (engine window)370,802 in the filenone; the random-length contract (110,000 board feet, $110 a point) last traded May 15, 2023, and the chained series runs past that date carrying the 27,500-board-foot contract listed August 8, 2022 (LBR, $27.50 a point). Since Sep 9, 2026 the engine reads LBS only to 2023-05-15 and prices the later bars as LBR (the next row), so dollars are right on both sides of the cut; the file is thin throughout (about 80 bars a day). Sources: firstratedata.com/i/futures/LBS; barchart.com LSK23 contract specifications; CME Group via madisonsreport.com, read Sep 6, 2026; the two-instrument window from instruments.py v0.2, Sep 9, 20260.1 / $110 to May 2023
LBR · Lumber (27,500 board feet, from May 16, 2023)2023-05-16 to 2026-10-30 (engine window on the LBS file)the LBS file's later barsnone; the same FirstRate series as LBS, read from 2023-05-16 at $27.50 a point (tick $0.50). Three years of history, so the short-history caution fires on every LBR run. Source: CME lumber (LBR) contract specifications; instruments.py v0.2, Sep 9, 2026—
LE · Live Cattle2008-01-15 to 2026-10-301,550,646none0.025 / $400
OJ · Orange Juice2008-02-25 to 2026-10-30643,765151 zero-volume bars0.05 / $150
SB · Sugar No. 112008-02-25 to 2026-10-302,499,152102 zero-volume bars0.01 / $1,120
XC · Mini Corn2008-02-24 to 2026-10-30863,436none0.125 / $10
ZC · Corn2008-02-19 to 2026-10-303,293,9311,925 zero-volume bars0.25 / $50
ZL · Soybean Oil2008-01-02 to 2026-10-303,157,6072,068 zero-volume bars0.01 / $600
ZM · Soybean Meal2008-02-24 to 2026-10-302,849,850696 rows failing the OHLC bounds check (2008 and 2009); 2,620 zero-volume bars0.1 / $100
ZO · Oats2008-02-24 to 2026-10-30435,5251,320 zero-volume bars0.25 / $50
ZR · Rough Rice2008-02-24 to 2026-10-30493,879608 zero-volume bars0.005 / $2,000
ZS · Soybeans2008-03-02 to 2026-10-303,517,0451,844 zero-volume bars0.25 / $50
ZW · Chicago Wheat2008-01-02 to 2026-10-303,410,0041,776 zero-volume bars0.25 / $50

Crypto

Coming from perpetual swaps? What is different here, and the catch.

ContractSpanOne-minute barsExcludedTick / $ per point
BTC · Bitcoin (CME, 5 BTC)2017-12-26 to 2026-10-301,877,236none5 / $5
MBT · Micro Bitcoin2021-05-02 to 2026-10-301,387,550none5 / $0.1
MET · Micro Ether2021-12-05 to 2026-10-30667,261none0.5 / $0.1

Where this comes from

The same loader reads the file before every run. Its rules: every line must parse; high at or above open and close, low at or below; high at or above low; volume at least one; timestamps strictly increasing. A line that fails any of them is excluded and reported with its reason. The engine never fills a gap, never smooths a bar, never adjusts a price.

Micro and mini contracts (MES, MNQ, M2K, MCL, MBT, MET, VXM) start in 2019 to 2021 because that is when they were listed; the report's short-history caution says so on their runs.

Measured on this file

Questions a trading forum asks of the file, answered on the whole file with the measurement written down before it ran, published either way. Does the Sunday gap fill on Monday? ES, 923 Mondays: Monday came back to Friday's close 53.1% of the time and went the same distance the other way 53.8%.

Which side of gold's first hour breaks first? 4,737 days: when the low forms first the high breaks first 63.9% of the time, and where price sits at 9:20 says more (69.3%).

Does NQ come back to its 7:00 open? 3,073 days: it came back on 74.0% of them, and to a random morning price on 76.0%.

Does NQ fill the gap? 4,777 gap days: a quarter of the gap filled 85.5% and 89.2% of the time, and a quarter of the gap the other way 87.0% and 88.2%; half the gap 75.4% and 80.1%, and half the other way 75.1% and 78.0%.

Does trading the gap fill make money? NQ, five runs on 4,788 gap days: small gaps to the prior close filled 72.4% of the time and lost $27,659 over eighteen years; big gaps to a quarter back made $23,132, and 2026 alone is $34,876 of it.

Does NQ break both ends of the premarket hour more on Mondays? 4,559 days: both ends of the 8:12 to 9:12 hour broke by the close on 70.8% of Mondays and 70.8% of Tuesdays; the hour’s width, 13 points on a Monday and 20.88 on a Friday, is what moves with it.