Our Energy Demand and Net Generation Forecasting platform aims to provide utilities and energy providers with an accurate, and automated solution for forecasting energy demand across the United States. The platform helps optimize energy production and distribution, reduce waste, and improve overall efficiency in the energy industry.
The platform is built using various AWS services, such as Amazon S3, ECS, EMR, EventBridge and AWS Lambda. The frontend is developed using Next.js and deployed on Vercel. The main programming languages used are JavaScript and Python.
The platform collects historical energy data, preprocesses it, and stores it in an S3 bucket. It then employs time series algorithms to predict future trends. The machine learning model is trained and deployed using Amazon ECS, EMR and Step Functions, with optimized hyperparameters to improve forecast accuracy. The model is automatically retrained periodically, ensuring up-to-date predictions.
Our frontend is designed using Next.js, ApexChart.js, and Material UI featuring an interactive and visually engaging user interface. The frontend displays various data visualizations, such as graphs, charts, and tables, enabling users to gain deeper insights into energy demand patterns.
Energy demand and net generation forecasts are updated weekly. Amazon EventBridge is used to trigger Step Functions which contains a workflow. The workflow begins with the retraining task, which involves running a Docker container in an ECS cluster. This container retrieves updated data from S3, performs model retraining, and stores the updated model files in S3 as pickle files. Once the model is trained on the new data, the next step is to generate a 1-year forecast. Step Functions triggers another task in ECS to run a Docker container in the ECS cluster. This container generates the new predictions and saves them in the designated S3 bucket.
Simply visit our website and navigate to the Plot or Compare section. There, you can explore various visualizations of energy demand and net generation data, as well as view the latest forecasted energy demand and net generation patterns.
Our platform sources energy demand data from the U.S. Energy Information Administration (EIA), a reputable and reliable source for energy-related information. You can learn more about EIA and their data by visiting their website: https://www.eia.gov/electricity/.
The U.S. Energy Information Administration (EIA) is a well-established and reputable source of energy-related data. EIA adheres to strict data collection and reporting standards, ensuring that the data provided is accurate, reliable, and up-to-date.
Yes, you can access the raw data provided by EIA directly from their website: https://www.eia.gov/electricity/. EIA offers a variety of tools and resources to help you explore and analyze their data, including APIs, Excel downloads, and interactive data browsers.