Breaking News
Investing Pro 0
💎 Access the Market Tools Trusted by Thousands of Investors Get Started

Where To Find Data

By David MerkelMarket OverviewJan 12, 2014 03:19AM ET
www.investing.com/analysis/where-to-find-data-198375
Where To Find Data
By David Merkel   |  Jan 12, 2014 03:19AM ET
Saved. See Saved Items.
This article has already been saved in your Saved Items
 

I have been a long time reader of your blog but writing for the first time. To me a key part of the investment process for a generalist investor has to be a way to efficiently screen stocks to generate investment ideas and also measure historical returns and fundametals for various industry groups under various economic conditions. I am curious as to what data sources you use in your own work for historical stock market and fundamental data? Do you pull this into your own database and do you use Excel or a statistical package for any quantitative backtests for your screens?

In a previous job I used FactSet to pull historical monthly pricing and quarterly fundamental data for a universe of over 100 regulated utility stocks (both current and past public firms). I also taught myself a fair bit of statistics along the way including logistic regressions and discriminant analysis in order to backtest different models for identifying outperformers, dividend growth/cuts etc. Unfortunately I had to do this all in Excel, which made the whole process pretty painful right on from cleaning up outliers, sorting etc. I guess for simple queries of stock performance and tracking various fundamental metrics over time it would work touse Excel.

One motivation for asking is that I hope to one day become an investing blogger myself, and am wondering if there are low cost ways of accesing this kind of data. Additionally I am always interest in real world methods people follow to prune the thousands of possible stocks to invest in to a smaller more promising subset that people can invest more time analyzing on a fundamental basis. To me the hallmark of a successful investor is the willingness to unturn many investing stones until a promising idea is found.

I am a tightwad when it comes to paying up for data or software. I use the following:

  • FRED
  • Yahoo Finance
  • Value Line via my local library
  • AAII Stock Investor (A screening package, but more than that)
  • The Wall Street Journal
  • Bloomberg.com
  • FINRA TRACE — bond data
  • Bureau of Labor Statistics
  • Federal Reserve (but not FRED)
  • Microsoft Excel
  • If I need to do something complex, I can use the open source statistics package R.

AAII Stock Investor and Value Line are my main screeners. I pay $100/year for AAII, and nothing for Value Line. Oh, my library gives me Morningstar for free as well. Both subscriptions are very full, and very useful as well.

Now all that said, though it is important to be able to access the data, developing the ability to interpret it is far more important. There can be too much rigor in trying to analyze quantitative data. You need to identify the three most significant variables that affect the result being analyzed and focus on analyzing them. Most investment questions can be analyzed through the three most important variables.

Though I do backtests occasionally, I am happier to stick with theory, and base my actions off that. Backtests are fraught with all sorts of bias, and basically say that the future will be like the past, only more so.

It would be great to have Bloomberg, FactSet, and some off-the-shelf statistics/programming package that integrates with them. But life is tough, and we don’t always have that luxury, so we have to seek out data on the cheap, and analyze it cheaply also.

That’s how I do it now, but if I get more clients, I will start paying up for data and software.

Where To Find Data
 

Related Articles

Where To Find Data

Add a Comment

Comment Guidelines

We encourage you to use comments to engage with other users, share your perspective and ask questions of authors and each other. However, in order to maintain the high level of discourse we’ve all come to value and expect, please keep the following criteria in mind:  

  •            Enrich the conversation, don’t trash it.

  •           Stay focused and on track. Only post material that’s relevant to the topic being discussed. 

  •           Be respectful. Even negative opinions can be framed positively and diplomatically. Avoid profanity, slander or personal attacks directed at an author or another user. Racism, sexism and other forms of discrimination will not be tolerated.

  • Use standard writing style. Include punctuation and upper and lower cases. Comments that are written in all caps and contain excessive use of symbols will be removed.
  • NOTE: Spam and/or promotional messages and comments containing links will be removed. Phone numbers, email addresses, links to personal or business websites, Skype/Telegram/WhatsApp etc. addresses (including links to groups) will also be removed; self-promotional material or business-related solicitations or PR (ie, contact me for signals/advice etc.), and/or any other comment that contains personal contact specifcs or advertising will be removed as well. In addition, any of the above-mentioned violations may result in suspension of your account.
  • Doxxing. We do not allow any sharing of private or personal contact or other information about any individual or organization. This will result in immediate suspension of the commentor and his or her account.
  • Don’t monopolize the conversation. We appreciate passion and conviction, but we also strongly believe in giving everyone a chance to air their point of view. Therefore, in addition to civil interaction, we expect commenters to offer their opinions succinctly and thoughtfully, but not so repeatedly that others are annoyed or offended. If we receive complaints about individuals who take over a thread or forum, we reserve the right to ban them from the site, without recourse.
  • Only English comments will be allowed.
  • Any comment you publish, together with your investing.com profile, will be public on investing.com and may be indexed and available through third party search engines, such as Google.

Perpetrators of spam or abuse will be deleted from the site and prohibited from future registration at Investing.com’s discretion.

Write your thoughts here
 
Are you sure you want to delete this chart?
 
Post
Post also to:
 
Replace the attached chart with a new chart ?
1000
Your ability to comment is currently suspended due to negative user reports. Your status will be reviewed by our moderators.
Please wait a minute before you try to comment again.
Thanks for your comment. Please note that all comments are pending until approved by our moderators. It may therefore take some time before it appears on our website.
 
Are you sure you want to delete this chart?
 
Post
 
Replace the attached chart with a new chart ?
1000
Your ability to comment is currently suspended due to negative user reports. Your status will be reviewed by our moderators.
Please wait a minute before you try to comment again.
Add Chart to Comment
Confirm Block

Are you sure you want to block %USER_NAME%?

By doing so, you and %USER_NAME% will not be able to see any of each other's Investing.com's posts.

%USER_NAME% was successfully added to your Block List

Since you’ve just unblocked this person, you must wait 48 hours before renewing the block.

Report this comment

I feel that this comment is:

Comment flagged

Thank You!

Your report has been sent to our moderators for review
Continue with Google
or
Sign up with Email