I finally got around to programming an easy Python down loader for CME data from Quandl. I promised this in my last book, but haven’t got that many requests. On the Ultimate Algorithmic Trading System…. page I have provided some data going back to early 2008 on several markers. This is a work in progress. I also wrote a back adjuster that rolls when the Open Interest + Volume is greater in the next contract and adjusts the data retroactively (Panama process) by the discount on the roll date. As I state on the web page this data is not all that great even though it looks like it comes directly from CME. I do fill in gaps and try to fix glaring errors so take it for what it is. Its good data for preliminary testing, but to finalize an algorithm or to trade by I would definitely go the “paid” route. Although the later data looks pretty good.
Before downloading the data I would sign up for Quandl and get an API key. You will be amazed at the amount of data they make available – free and paid subscriptions.
Subscribe to get the latest posts sent to your email.
6 thoughts on “Back Adjusted Continuous Contract Data from Quandl”
I subscribe to Quandl for data. Would you agree that the most appropriate futures continuous contract data for simulating historical trades in doaars would be 1st contract, backwards panama, open interest switch? Thank you.
Hi, again Richard. Quandl no longer offers the individual CME data contracts that I was using to link the contracts together. They do offer a database that includes all of the front months in a single file. They also have the second month in files as well. From this data, you can splice together an adjusted continuous contract. The backwards panama with OI triggers is a great algorithm to use. Some prefer a volume and OI trigger. But I think you can get a robust database using just OI.
Hi Richard, I chanced upon your insightful website. Could I check if you know Quandl\’s Terminology? For example, when it indicates S&P 500 Futures, Continuous Contract #2, does it mean this is the second month as you mentioned above?
Quandl uses the number following the futures name to show which “month out” the data refers to.
For example #1 for SP500 is the front month contract and it will flip when the contract expires [Mar, June, Sep, Dec]
Prior to expiration of #1 the #2 contract will experience higher volume and or open interest – when this occurs you would switch to #2 before #1 expires
Once contract #1 expires it #2 is implemented and #3 becomes #2 and so on.
Normally you would trade #1 in the SP
Contract #1
March Contract Dec 1x, Jan, Feb, March 1x
June Contract March 1x, Apr, May, June 1x
Sept Contract June1x, July, Aug, Sept 1x
Dec Contract Sept 1x, Oct, Nov, Dec 1x
Contract #2
June Contract Mar 1x +1, Contract #1 expiration date [March] – about 5 trading days
Sept Contract June 1x +1, Contract #1 expiration date [June]
Dec Contract Sept 1x+ 1, Contract #1 expiration date [Sept]
Mar Contract Dec 1x +1, Contract #1 expriration date[Dec’
Thanks for your reply. Cant believe that I missed it (no email notification or I might have missed it).
When constructing the continuous futures data, do you account for the fact that it\’s possible that 1st 2 contracts may not be the most liquid? If we go down the depth (beyond second contract), I would imagine that the panama stitching is going to be a nightmare.
The stitching is a nightmare for sure. You absolutely correct sometimes you have to dig down to 4 levels of contracts to get the data you need – high volume and high opInt. My code goes 4 levels but I am still disappointed with the quality of the QUANDL free data. It was great when the CME posted their historical data for free in individual contract format. I wished they would publish it once every six months – even if it was a few months old. One day maybe!
Backtesting with [Trade Station,Python,AmiBroker, Excel]. Intended for informational and educational purposes only!
Get All Five Books in the Easing Into EasyLanguage Series - The Trend Following Edition is now Available!
Announcement – A Trend Following edition has been added to my Easing into EasyLanguage Series! This edition will be the fifth and final installment and will utilize concepts discussed in the Foundation editions. I will pay respect to the legends of Trend Following by replicating the essence of their algorithms. Learn about the most prominent form of algorithmic trading. But get geared up for it by reading the first four editions in the series now. Get your favorite QUANT the books they need!
The Foundation Edition. The first in the series.
This series includes five editions that covers the full spectrum of the EasyLanguage programming language. Fully compliant with TradeStation and mostly compliant with MultiCharts. Start out with the Foundation Edition. It is designed for the new user of EasyLanguage or for those you would like to have a refresher course. There are 13 tutorials ranging from creating Strategies to PaintBars. Learn how to create your own functions or apply stops and profit objectives. Ever wanted to know how to find an inside day that is also a Narrow Range 7 (NR7?) Now you can, and the best part is you get over 4 HOURS OF VIDEO INSTRUCTION – one for each tutorial.
Hi-Res Edition Cover
This book is ideal for those who have completed the Foundation Edition or have some experience with EasyLanguage, especially if you’re ready to take your programming skills to the next level. The Hi-Res Edition is designed for programmers who want to build intraday trading systems, incorporating trade management techniques like profit targets and stop losses. This edition bridges the gap between daily and intraday bar programming, making it easier to handle challenges like tracking the sequence of high and low prices within the trading day. Plus, enjoy 5 hours of video instruction to guide you through each tutorial.
Advanced Topics Cover
The Advanced Topics Edition delves into essential programming concepts within EasyLanguage, offering a focused approach to complex topics. This book covers arrays and fixed-length buffers, including methods for element management, extraction, and sorting. Explore finite state machines using the switch-case construct, text graphic manipulation to retrieve precise X and Y coordinates, and gain insights into seasonality with the Ruggiero/Barna Universal Seasonal and Sheldon Knight Seasonal methods. Additionally, learn to build EasyLanguage projects, integrate fundamental data like Commitment of Traders, and create multi-timeframe indicators for comprehensive analysis.
Get Day Trading Edition Today!
The Day Trading Edition complements the other books in the series, diving into the popular approach of day trading, where overnight risk is avoided (though daytime risk still applies!). Programming on high-resolution data, such as five- or one-minute bars, can be challenging, and this book provides guidance without claiming to be a “Holy Grail.” It’s not for ultra-high-frequency trading but rather for those interested in techniques like volatility-based breakouts, pyramiding, scaling out, and zone-based trading. Ideal for readers of the Foundation and Hi-Res editions or those with EasyLanguage experience, this book offers insights into algorithms that shaped the day trading industry.
Trend Following Cover.
For thirty-one years as the Director of Research at Futures Truth Magazine, I had the privilege of collaborating with renowned experts in technical analysis, including Fitschen, Stuckey, Ruggiero, Fox, and Waite. I gained invaluable insights as I watched their trend-following methods reach impressive peaks, face sharp declines, and ultimately rebound. From late 2014 to early 2020, I witnessed a dramatic downturn across the trend-following industry. Iconic systems like Aberration, CatScan, Andromeda, and Super Turtle—once thriving on robust trends of the 1990s through early 2010s—began to falter long before the pandemic. Since 2020 we have seen the familiar trends return. Get six hours of video instruction with this edition.
Pick up your copies today – e-Book or paperback format – at Amazon.com
I subscribe to Quandl for data. Would you agree that the most appropriate futures continuous contract data for simulating historical trades in doaars would be 1st contract, backwards panama, open interest switch? Thank you.
Hi, again Richard. Quandl no longer offers the individual CME data contracts that I was using to link the contracts together. They do offer a database that includes all of the front months in a single file. They also have the second month in files as well. From this data, you can splice together an adjusted continuous contract. The backwards panama with OI triggers is a great algorithm to use. Some prefer a volume and OI trigger. But I think you can get a robust database using just OI.
Hi Richard, I chanced upon your insightful website. Could I check if you know Quandl\’s Terminology? For example, when it indicates S&P 500 Futures, Continuous Contract #2, does it mean this is the second month as you mentioned above?
Thanks!
https://www.quandl.com/data/CHRIS/CME_SP2-S-P-500-Futures-Continuous-Contract-2-SP2
Hello Jirong,
Quandl uses the number following the futures name to show which “month out” the data refers to.
For example #1 for SP500 is the front month contract and it will flip when the contract expires [Mar, June, Sep, Dec]
Prior to expiration of #1 the #2 contract will experience higher volume and or open interest – when this occurs you would switch to #2 before #1 expires
Once contract #1 expires it #2 is implemented and #3 becomes #2 and so on.
Normally you would trade #1 in the SP
Contract #1
March Contract Dec 1x, Jan, Feb, March 1x
June Contract March 1x, Apr, May, June 1x
Sept Contract June1x, July, Aug, Sept 1x
Dec Contract Sept 1x, Oct, Nov, Dec 1x
Contract #2
June Contract Mar 1x +1, Contract #1 expiration date [March] – about 5 trading days
Sept Contract June 1x +1, Contract #1 expiration date [June]
Dec Contract Sept 1x+ 1, Contract #1 expiration date [Sept]
Mar Contract Dec 1x +1, Contract #1 expriration date[Dec’
Hi George
Thanks for your reply. Cant believe that I missed it (no email notification or I might have missed it).
When constructing the continuous futures data, do you account for the fact that it\’s possible that 1st 2 contracts may not be the most liquid? If we go down the depth (beyond second contract), I would imagine that the panama stitching is going to be a nightmare.
Jirong
Hi Jirong,
The stitching is a nightmare for sure. You absolutely correct sometimes you have to dig down to 4 levels of contracts to get the data you need – high volume and high opInt. My code goes 4 levels but I am still disappointed with the quality of the QUANDL free data. It was great when the CME posted their historical data for free in individual contract format. I wished they would publish it once every six months – even if it was a few months old. One day maybe!