Skip to main content Accessibility help
×
Hostname: page-component-cd9895bd7-fscjk Total loading time: 0 Render date: 2024-12-23T01:03:53.450Z Has data issue: false hasContentIssue false

11 - Big Data

Published online by Cambridge University Press:  14 November 2024

Philip Hans Franses
Affiliation:
Erasmus University
Get access

Summary

Currently we may have access to large databases, sometimes coined as Big Data, and for those large datasets simple econometric models will not do. When you have a million people in your database, such as insurance firms or telephone providers or charities, and you have collected information on these individuals for many years, you simply cannot summarize these data using a small-sized econometric model with just a few regressors. In this chapter we address diverse options for how to handle Big Data. We kick off with a discussion about what Big Data is and why it is special. Next, we discuss a few options such as selective sampling, aggregation, nonlinear models, and variable reduction. Methods such as ridge regression, lasso, elastic net, and artificial neural networks are also addressed; these latter concepts are nowadays described as so-called machine learning methods. We see that with these methods the number of choices rapidly increases, and that reproducibility can reduce. The analysis of Big Data therefore comes at a cost of more analysis and of more choices to make and to report.

Type
Chapter
Information
Ethics in Econometrics
A Guide to Research Practice
, pp. 248 - 268
Publisher: Cambridge University Press
Print publication year: 2024

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Save book to Kindle

To save this book to your Kindle, first ensure [email protected] is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

  • Big Data
  • Philip Hans Franses, Erasmus University
  • Book: Ethics in Econometrics
  • Online publication: 14 November 2024
  • Chapter DOI: https://doi.org/10.1017/9781009428033.013
Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

  • Big Data
  • Philip Hans Franses, Erasmus University
  • Book: Ethics in Econometrics
  • Online publication: 14 November 2024
  • Chapter DOI: https://doi.org/10.1017/9781009428033.013
Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

  • Big Data
  • Philip Hans Franses, Erasmus University
  • Book: Ethics in Econometrics
  • Online publication: 14 November 2024
  • Chapter DOI: https://doi.org/10.1017/9781009428033.013
Available formats
×