Updated thesis and added quantile performance plots to non autoregressive quantiles

This commit is contained in:
2024-05-04 14:13:37 +02:00
parent 074e654b8a
commit e0c42797e0
21 changed files with 337 additions and 349 deletions

Binary file not shown.

After

Width:  |  Height:  |  Size: 88 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 89 KiB

View File

@@ -25,7 +25,7 @@
\@writefile{lof}{\contentsline {figure}{\numberline {4}{\ignorespaces Example of the diffusion process. The image of a cat is generated by starting from noise and iteratively denoising the image.\relax }}{12}{figure.caption.6}\protected@file@percent }
\newlabel{fig:diffusion_example}{{4}{12}{Example of the diffusion process. The image of a cat is generated by starting from noise and iteratively denoising the image.\relax }{figure.caption.6}{}}
\@writefile{toc}{\contentsline {subsubsection}{\numberline {3.4.3}Generation process}{12}{subsubsection.3.4.3}\protected@file@percent }
\newlabel{fig:diffusion_process}{{\caption@xref {fig:diffusion_process}{ on input line 279}}{14}{Generation process}{figure.caption.7}{}}
\newlabel{fig:diffusion_process}{{\caption@xref {fig:diffusion_process}{ on input line 281}}{14}{Generation process}{figure.caption.7}{}}
\@writefile{toc}{\contentsline {subsection}{\numberline {3.5}Evaluation}{14}{subsection.3.5}\protected@file@percent }
\@writefile{lof}{\contentsline {figure}{\numberline {5}{\ignorespaces Visualization of the CRPS metric\relax }}{15}{figure.caption.8}\protected@file@percent }
\newlabel{fig:crps_visualization}{{5}{15}{Visualization of the CRPS metric\relax }{figure.caption.8}{}}

View File

@@ -159,6 +159,8 @@ The quantile regression method can be used with both types of models. The autore
The non-autoregressive model will output the quantiles for all quarters of the day based on the input features. The cumulative distribution functions all need to be reconstructed and samples can be drawn from each of the distributions. When sampling from the distributions at once, the samples are independent of each other. The sample for the next quarter does not depend on the sample of the previous quarter which can result in some unrealistic samples.
The input features for autoregressive and non-autoregressive also differ. When forecasted features are used, the autoregressive model only uses the forecasted values for the next quarter while the non-autoregressive model uses the forecasted values for all quarters of the day. In theory, the autoregressive model should also be able to use forecasted values for quarters further in the future but this makes it harder to use in practice. When the last quarter of a day needs to be predicted, the forecasted values for the next day are needed which are not available. For simplicity, during this thesis, the autoregressive model will only be provided with the forecasted values for the next quarter.
\subsection{Model Types}
\subsubsection{Linear Model}
A simple linear model can be used as a baseline to compare the more complex models. This model assumes a linear relation exists between the input features and the output. The relationship is modeled using the following formula:

View File

@@ -5,6 +5,8 @@ The electricity market is a complex system influenced by numerous factors. The r
Forecasting the imbalance price is vital for market participants engaged in buying or selling electricity. It enables them to make informed decisions on the optimal times to buy or sell, aiming to maximize their profits. However, current industry practices often rely on simplistic policies, such as adhering to a fixed price for transactions. This approach is not optimal and overlooks the potential benefits of adaptive policies that consider the forecasted imbalance prices.
The goal of this thesis is to generatively model the Belgian electricity market. This allows to reconstruct the imbalance price for a given day which can then be used by other simple policies to make decisions on when to buy or sell electricity. These policies can then be compared to the current industry practices to assess their performance.
The goal of this thesis is to generatively model the Belgian electricity market. This allows the reconstruction of the imbalance price for a given day which can then be used by other simple policies to make decisions on when to buy or sell electricity. These policies can then be compared to the current industry practices to assess their performance.
Forecasting the system imbalance will become increasingly important as the share of renewable energy sources continues to grow.
Forecasting the system imbalance will become increasingly important as the share of renewable energy sources continues to grow.
This thesis can be divided into two main parts. The first part focuses on modeling the Net Regulation Volume (NRV) of the Belgian electricity market for the next day. This modeling is conditioned on multiple inputs that can be obtained from Elia (TODO: add citation to the open data of Elia). The second part of the thesis focuses on optimizing a simple policy using the NRV generations for the next day. The policy tries to maximize profit by charging and discharging a battery and thereby buying and selling electricity on the market. Multiple models are trained and tested to model the NRV and compared to each other based on their profit optimization.

View File

@@ -41,33 +41,43 @@ TODO: ask Jonas: add urls to the correct data? via citation?
A lot of data is available but only the most relevant data needs to be used. Experiments will be done to identify which data and features improve the NRV modeling. The data will be split into a training and test set. The training dataset starts depending on which data features are used but ends on 31-12-2022. The test set starts on 01-01-2023 and ends on (TODO: check the end date). This makes sure enough data is available to train the models and the test set is large enough to evaluate the models. The year 2023 is chosen as the test set because it is the most recent data available when the thesis experiments were conducted. Using data from 2022 in the test set also does not make a lot of sense because the trained models would be used to predict the future. Data from 2022 is not relevant anymore to evaluate the models.
\subsubsection{Linear Model}
% TODO: is it necessary to provide the parameter calculation?
The linear model outputs the values for the chosen quantiles. The total amount of parameters depends on the input features and the number of chosen quantiles. Assuming the input features are the 96 previous NRV values and 13 quantiles are chosen, the total amount of parameters is $96 * 13 + 13 = 1261$. The linear model is trained using the Adam optimizer with a learning rate of 1e-4. Early stopping is used with a patience of 5 epochs. Different sets of input features are experimented with and are compared to each other based on the previously mentioned metrics. All results are shown in Table \ref{tab:autoregressive_linear_model_baseline_results}.
\\\\
% TODO: ask Jonas: add number of parameters to this table?
\begin{table}[ht]
\centering
\begin{tabular}{@{}lcccccc@{}}
\toprule
& \multicolumn{2}{c}{MSE} & \multicolumn{2}{c}{MAE} & \multicolumn{2}{c}{CRPS} \\
\cmidrule(lr){2-3} \cmidrule(lr){4-5} \cmidrule(lr){6-7}
& Train & Test & Train & Test & Train & Test \\
\midrule
NRV & 35307.34 & 39222.41 & 146.38 & 152.49 & 88.46 & 91.56 \\
NRV + Load & 34274.70 & 39266.29 & 144.20 & 152.54 & 85.84 & 90.36 \\
NRV + PV & 33099.80 & 37489.68 & 141.57 & 149.32 & 84.87 & 89.42 \\
NRV + Load + PV & 32777.86 & 37642.66 & 141.01 & 149.90 & 83.40 & 89.34 \\
NRV + Load + Wind & 33009.05 & 39284.68 & 141.20 & 152.32 & 82.46 & 88.60 \\
NRV + Load + PV + Wind & 29816.77 & 36134.87 & 133.89 & 146.22 & 78.19 & 84.56 \\
NRV + Load + Wind + Net Position & 31634.27 & 37890.66 & 137.87 & 149.37 & 81.17 & 86.19 \\
NRV + Load + PV + Wind + Net Position & 29034.53 & \textbf{35725.42} & 131.87 & \textbf{145.64} & 76.23 & \textbf{83.30} \\
\bottomrule
\end{tabular}
\caption{Autoregressive linear model results}
\label{tab:autoregressive_linear_model_baseline_results}
\end{table}
% TODO: explainedi nsection reference ?
The simplest model to be trained for the NRV modeling is the linear model. The linear model is trained using the pinball loss function explained in the section above. The outputs of the model are values for the chosen quantiles. The linear model can be trained in an autoregressive and non-autoregressive way. Both methods will be compared to each other. The linear model is trained using the Adam optimizer with a learning rate of 1e-4. Early stopping is used with a patience of 5 epochs. The linear model is evaluated using the mean squared error (MSE), mean absolute error (MAE), and continuous ranked probability score (CRPS). The influence of the input features is also evaluated by training the models with different input feature sets.
The linear model outputs the quantiles for the next quarter based on the given input features. The input features consist of previous history values of a certain feature or forecasts of a certain feature. The model, however, does not know which quarter of the day it is modeling. This is important information because as seen in Figure \ref{fig:nrv_mean_std_over_quarter}, the mean and standard deviation of the NRV values change over the day. The model should be able to capture this information given the quarter of the day.
There is a big difference in the number of parameters between the autoregressive linear model and the non-autoregressive linear model. The autoregressive model only needs to output the NRV quantiles for one value while the non-autoregressive model needs to output the NRV quantiles for all the quarters of the day. Assuming thirteen quantiles are used, the autoregressive has 13 output parameters while the non-autoregressive model has 13 * 96 = 1248 output parameters. The total number of parameters for the autoregressive model is 13 * (number of input features + 1) while the total number of parameters for the non-autoregressive model is 13 * 96 * (number of input features + 1). Assuming only the NRV history of the previous day is used as input features, the autoregressive model has 1261 trainable parameters while the non-autoregressive model has 121056 parameters. This is a huge difference in the number of parameters and thus the complexity of the model.
\begin{table}[ht]
\centering
\begin{tabular}{@{}lcccccc@{}}
\toprule
& \multicolumn{2}{c}{MSE} & \multicolumn{2}{c}{MAE} & \multicolumn{2}{c}{CRPS} \\
\cmidrule(lr){2-3} \cmidrule(lr){4-5} \cmidrule(lr){6-7}
& AR & NAR & AR & NAR & AR & NAR \\
\midrule
NRV & 39222.41 & 41219.98 & 152.49 & 152.26 & 91.56 & \textbf{73.97} \\
NRV + Load & 39266.29 & 47045.17 & 152.54 & 163.24 & 90.36 & 79.72 \\
% NRV + PV & 37489.68 & & 149.32 & & 89.42 & \\ No NAR experiment
NRV + Load + PV & 37642.66 & 46404.63 & 149.90 & 161.82 & 89.34 & 79.74 \\
NRV + Load + Wind & 39284.68 & 48148.10 & 152.32 & 164.84 & 88.60 & 79.51 \\
NRV + Load + PV + Wind & 36134.87 & 50312.85 & 146.22 & 169.06 & 84.56 & 79.85 \\
NRV + Load + Wind + NP & 37890.66 & 49442.48 & 149.37 & 167.90 & 86.19 & 76.72 \\
NRV + Load + PV + Wind + NP & \textbf{35725.42} & 49132.26 & \textbf{145.64} & 167.37 & 83.30 & 78.75 \\
\bottomrule
\end{tabular}
\caption{Linear model results}
\label{tab:linear_model_baseline_results}
\end{table}
Comparing the results of the autoregressive and non-autoregressive linear models, it can be seen that the non-autoregressive model has a higher MSE and MAE on the test set. The CRPS is, however, lower for the non-autoregressive model. The CRPS is calculated using the outputted quantiles while the MSE and MAE are calculated by sampling from the reconstructed distributions. Because of error propagation in the autoregressive model, the outputted quantiles also contain more error which leads to a higher CRPS. The non-autoregressive model does not suffer from this problem. During the training of the autoregressive model, the model does not take into account that it will be used to generate full-day samples and thus the error is propagated. This is one possible explanation for the higher CRPS of the autoregressive model.
The MSE and MAE of the non-autoregressive model are higher than the autoregressive model. This can be explained by the fact that the non-autoregressive model does not take into account the previous sampled value. Sampling is done for every quarter of the day independently. This can lead to large differences between the sampled values and thus can increase the MSE and MAE. The autoregressive model does take into account the previous sampled value and can adapt its quantile predictions based on this value so a smoother and more accurate sample can be generated.
% TODO: Check listing of features -> hoofdletters en shit
Another thing to note is the influence of the input features on the non-autoregressive linear model. When increasing the number of input features, the evaluation metrics are a lot worse in comparison with only using the NRV history of the previous day. A reason for this behavior could be that the model is not able to capture the patterns in the data because of the huge amount of input parameters. When using the NRV, Load, Photovoltanic power production, Wind power production, and the Net Position as input features, the non-autoregressive model has an input size of 864. This increases the complexity of the model as well. The total number of trainable parameters becomes 1,079,520. This is a huge number of parameters and the model is not able to learn the patterns in the data anymore.
The performance of the autoregressive linear model, however, improves with the addition of more input features. When using the NRV, Load, Photovoltanic power production, Wind power production, and the Net Position as input features, the autoregressive model has an input size of 484. This is almost half the size of the non-autoregressive model. The total number of trainable parameters becomes 6,305 which is way less than the non-autoregressive model.
An important thing to note is that the autoregressive model needs an additional feature to know which quarter of the day it is modeling. The quarter of the day also influences the value of the NRV. This can easily be seen in Figure \ref{fig:nrv_mean_std_over_quarter}. The figure shows the mean and standard deviation of the NRV values over the quarter of the day. These values change over the day which means the quarter is very valuable information for the model. The non-autoregressive on the other hand does not need this information because it models all the quarters of the day at once.
\begin{figure}[ht]
\centering
@@ -76,136 +86,83 @@ The linear model outputs the quantiles for the next quarter based on the given i
\label{fig:nrv_mean_std_over_quarter}
\end{figure}
Multiple methods exist to provide such information to the model. The quarter of the day can be provided as a one-hot encoded vector. The cyclic nature of the quarter would not be captured using a one-hot encoded vector. The vectors for quarter 0 and quarter 95 would be very different while they should be very close to each other. Other methods exist that do take the cyclic property of the quarter into account. Trigonometric functions can be used to provide the quarter of the day information. The quarter of the day can be mapped to a sine and cosine value which can be used as input features. The sine and cosine values are calculated as follows:
Providing the autoregressive model with the quarter of the day can be done in multiple ways. The quarter of the day can be provided as a one-hot encoded vector. The cyclic nature of the quarter would not be captured using a one-hot encoded vector. The vectors for quarter 0 and quarter 95 would be very different while they should be very close to each other. Other methods exist that do take the cyclic property of the quarter into account. Trigonometric functions can be used to provide the quarter of the day information. The quarter of the day can be mapped to a sine and cosine value which can be used as input features. The sine and cosine values are calculated as follows:
\begin{equation}
\text{sin}(\frac{2\pi}{96} \times \text{quarter}) \quad \text{and} \quad \text{cos}(\frac{2\pi}{96} \times \text{quarter})
\end{equation}
The sine and cosine values are then concatenated with the input features. Another method that can be used is adding an embedding layer to the model. The discrete quarter of the day value can then be mapped to a vector. The embedding layer itself is learned during the training process which allows the model to learn patterns between quarters. The length of the embedding vector can be chosen and experimented with. The quarter-of-the-day information is then concatenated with the input features. Other information (eg. day of the week, month, year) can also easily be added to the model using this method by just increasing the size of the embedding layer. The results of the linear model with the quarter information are shown in Table \ref{tab:autoregressive_linear_model_quarter_embedding_baseline_results}. The results show that adding the quarter embedding to the model improves the performance of the linear model.
\\\\
The sine and cosine values are then concatenated with the input features. Another method that can be used is adding an embedding layer to the model. The discrete quarter of the day value can then be mapped to a vector. The embedding layer itself is learned during the training process which allows the model to learn patterns between quarters. The length of the embedding vector can be chosen and experimented with. The quarter-of-the-day information is then concatenated with the input features. Other information (eg. day of the week, month, year) can also easily be added to the model using this method by just increasing the size of the embedding layer. The results of the linear model with the quarter information are shown in Table \ref{tab:autoregressive_linear_model_quarter_embedding_baseline_results}.
% TODO: Ask Jonas: Find cleaner way to present this table (remove repitition)
% TODO: Add more time information like day of week, month
\begin{table}[ht]
\centering
\begin{tabular}{@{}lcccccc@{}}
\begin{tabular}{@{}lccc@{}}
\toprule
& \multicolumn{2}{c}{MSE} & \multicolumn{2}{c}{MAE} & \multicolumn{2}{c}{CRPS} \\
\cmidrule(lr){2-3} \cmidrule(lr){4-5} \cmidrule(lr){6-7}
& Train & Test & Train & Test & Train & Test \\
& \multicolumn{1}{c}{MSE} & \multicolumn{1}{c}{MAE} & \multicolumn{1}{c}{CRPS} \\
\midrule
NRV & 35307.34 & 39222.41 & 146.38 & 152.49 & 88.46 & 91.56 \\
NRV + Quarter Trigonometric & 35243.28 & 39069.96 & 146.18 & 152.06 & 87.84 & 90.90 \\
NRV + Quarter Embedding \textbf{(2 dim)} & 34412.60 & \textbf{38216.27} & 144.35 & \textbf{150.41} & 86.59 & \textbf{89.69} \\
NRV + Quarter Embedding \textbf{(5 dim)} & 34801.22 & 38617.17 & 145.22 & 151.20 & 86.64 & 89.72 \\
NRV + Quarter Embedding \textbf{(8 dim)} & 34558.29 & 38423.30 & 144.73 & 150.89 & 86.59 & 89.81 \\
NRV & 39222.41 & 152.49 & 91.56 \\
NRV + QT & 39069.96 & 152.06 & 90.90 \\
NRV + QE \textbf{(2 dim)} & \textbf{38216.27} & \textbf{150.41} & \textbf{89.69} \\
NRV + QE \textbf{(5 dim)} & 38617.17 & 151.20 & 89.72 \\
NRV + QE \textbf{(8 dim)} & 38423.30 & 150.89 & 89.81 \\
\midrule
NRV + Load + PV + Wind + Net Position & 29034.53 & 35725.42 & 131.87 & 145.64 & 76.23 & 83.30 \\
NRV + Load + PV + Wind + Net Position \\ + Quarter Trigonometric & 28239.01 & 34783.13 & 130.30 & 143.98 & 76.59 & 84.21 \\
NRV + Load + PV + Wind + Net Position \\ + Quarter Embedding \textbf{(2 dim)} & 28667.13 & 35746.01 & 131.20 & 146.01 & 77.28 & 85.54 \\
NRV + Load + PV + Wind + Net Position \\ + Quarter Embedding \textbf{(5 dim)} & 27407.41 & \textbf{34031.71} & 128.31 & \textbf{142.29} & 72.06 & \textbf{79.99} \\
NRV + Load + PV + Wind + NP & 35725.42 & 145.64 & 83.30 \\
NRV + Load + PV + Wind + NP + QT & 34783.13 & 143.98 & 84.21 \\
NRV + Load + PV + Wind + NP + QE \textbf{(2 dim)} & 35746.01 & 146.01 & 85.54 \\
NRV + Load + PV + Wind + NP + QE \textbf{(5 dim)} & \textbf{34031.71} & \textbf{142.29} & \textbf{79.99} \\
\bottomrule
\end{tabular}
\caption{Autoregressive linear model results with time features}
\label{tab:autoregressive_linear_model_quarter_embedding_baseline_results}
\end{table}
Some examples of the sampled full NRV day samples are shown in figure \ref{fig:autoregressive_linear_model_samples}. The figure shows the real NRV values and the confidence intervals calculated based on 1000 full-day NRV samples. The mean of these samples is also plotted in the figure. The confidence intervals show the uncertainty of the NRV values. When the confidence interval is large, the model is not very certain about the NRV value and samples the NRV for that quarter with a high variance. The confidence intervals seen in the figure are quite narrow and do not always capture the real NRV value.
% TODO: explain more what we see in the figure, we see the small peaks every hour. Talk about the problem of autoregression (error propagation)
The results show that adding the quarter embedding to the model improves all evaluation metrics for the autoregressive linear model. The quarter embedding is a valuable feature for the model.
\begin{figure}[ht]
\centering
\begin{subfigure}[b]{0.49\textwidth}
\includegraphics[width=\textwidth]{images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_864.png}
\caption{Sample 1}
\label{fig:autoregressive_linear_model_sample_1}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.49\textwidth}
\includegraphics[width=\textwidth]{images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_4320.png}
\caption{Sample 2}
\label{fig:autoregressive_linear_model_sample_2}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.49\textwidth}
\includegraphics[width=\textwidth]{images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_6336.png}
\caption{Sample 3}
\label{fig:autoregressive_linear_model_sample_3}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.49\textwidth}
\includegraphics[width=\textwidth]{images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_7008.png}
\caption{Sample 4}
\label{fig:autoregressive_linear_model_sample_4}
\end{subfigure}
\caption{Test examples of the autoregressive linear model. The plots show the confidence intervals calculated from 1000 generated full-day NRV samples. The samples were generated using input features NRV, Load, Wind, PV, Net Position and the quarter embedding.}
\label{fig:autoregressive_linear_model_samples}
\end{figure}
Some examples of the generated full-day NRV samples are shown in Figure \ref{fig:autoregressive_linear_model_samples}. The examples are taken from the test set. The figure shows the confidence intervals of the NRV generations and the mean NRV prediction. The confidence intervals and mean are calculated based on 1000 generated full-day NRV samples. The samples were generated using the input features NRV, Load, Wind, PV, Net Position, and the quarter embedding for the autoregressive model.
The linear model is a simple model and can be used as a baseline to compare with the more complex models. From the examples in figure \ref{fig:autoregressive_linear_model_samples}, it can be seen that the model is already modeling the NRV reasonably well. There is, however, room for improvement.
\\\\
% ----------- Non-autoregressive model -----------
Until now, only the autoregressive linear model has been discussed. The non-autoregressive linear model can also be used to model the NRV and generate full-day samples. The model will now output the quantiles for every quarter of the day. The number of output values can be calculated as the number of quarters in a day multiplied by the number of quantiles. From this output, the cumulative distribution functions for every quarter of the day can be reconstructed. These functions can then be used to sample the NRV values for each quarter. There is a problem with this approach. The sampled NRV values are independent of each other. The NRV sample for the next quarter does not depend on what value was sampled for the quarter before.
\\\\
Training the non-autoregressive quantile model can be done in the same way as the autoregressive model. Now the pinball loss is calculated for every quarter of the day and the mean is taken over all the quarters. The models are also trained using the Adam optimizer with a learning rate of 1e-4. Early stopping is used with a patience of 5 epochs. Results of the non-autoregressive linear model are shown in Table \ref{tab:non_autoregressive_linear_model_baseline_results}.
\begin{table}[ht]
\centering
\begin{tabular}{@{}lcccccc@{}}
\toprule
& \multicolumn{2}{c}{MSE} & \multicolumn{2}{c}{MAE} & \multicolumn{2}{c}{CRPS} \\
\cmidrule(lr){2-3} \cmidrule(lr){4-5} \cmidrule(lr){6-7}
& Train & Test & Train & Test & Train & Test \\
\midrule
NRV & 37690.02 & 41219.98 & 147.54 & 152.26 & 67.94 & 73.97 \\
NRV + Load & 38461.93 & 47045.17 & 149.85 & 163.24 & 69.68 & 79.72 \\
NRV + Load + PV & 37891.53 & 46404.63 & 148.95 & 161.82 & 69.02 & 79.74 \\
NRV + Load + Wind & 38113.90 & 48148.10 & 148.76 & 164.84 & 68.21 & 79.51 \\
NRV + Load + PV + Wind & 39072.94 & 50312.85 & 151.07 & 169.06 & 68.40 & 79.85 \\
NRV + Load + Wind + Net Position & 39505.20 & 49442.48 & 151.65 & 167.90 & 68.69 & 76.72 \\
\bottomrule
\end{tabular}
\caption{Non-Autoregressive linear model results}
\label{tab:non_autoregressive_linear_model_baseline_results}
\end{table}
In Figure \ref{fig:non_autoregressive_linear_model_samples}, some examples of the sampled full NRV day samples are shown. The confidence intervals are calculated based on 1000 full-day NRV samples. The mean of these samples is also plotted in the figure. The confidence intervals show the uncertainty of the NRV values. The same test set examples are used as the examples of the autoregressive linear model shown in Figure \ref{fig:autoregressive_linear_model_samples}.
\begin{figure}[ht]
\begin{figure}[H]
\centering
\begin{subfigure}[b]{0.49\textwidth}
\includegraphics[width=\textwidth]{images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_864.png}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.49\textwidth}
\includegraphics[width=\textwidth]{images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_864.png}
\caption{Sample 1}
\label{fig:non_autoregressive_linear_model_sample_1}
\end{subfigure}
\begin{subfigure}[b]{0.49\textwidth}
\includegraphics[width=\textwidth]{images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_4320.png}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.49\textwidth}
\includegraphics[width=\textwidth]{images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_4320.png}
\caption{Sample 2}
\label{fig:non_autoregressive_linear_model_sample_2}
\end{subfigure}
\begin{subfigure}[b]{0.49\textwidth}
\includegraphics[width=\textwidth]{images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_6336.png}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.49\textwidth}
\includegraphics[width=\textwidth]{images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_6336.png}
\caption{Sample 3}
\label{fig:non_autoregressive_linear_model_sample_3}
\end{subfigure}
\begin{subfigure}[b]{0.49\textwidth}
\includegraphics[width=\textwidth]{images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_7008.png}
\caption{Autoregressive linear model}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.49\textwidth}
\includegraphics[width=\textwidth]{images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_7008.png}
\caption{Sample 4}
\label{fig:non_autoregressive_linear_model_sample_4}
\caption{Non-autoregressive linear model}
\end{subfigure}
\caption{Test examples of the non-autoregressive linear model. The plots show the confidence intervals calculated from 1000 generated full-day NRV samples. The samples were generated using input features NRV, Load, Wind, PV and the Net Position.}
\label{fig:non_autoregressive_linear_model_samples}
\end{figure}
\caption{Comparison of the autoregressive and non-autoregressive linear model samples.}
\label{fig:linear_model_sample_comparison}
\end{figure}
When looking at the examples in Figure \ref{fig:linear_model_sample_comparison}, it can be seen that the autoregressive linear model is already modeling the NRV quite well. The confidence intervals are quite small and the mean of the samples follows the trend of the real NRV. The mean of the samples, however, is way smoother than the real NRV. The real NRV has more peaks and fluctuations. The examples of the non-autoregressive model show another behavior. The confidence intervals are not as contained as the autoregressive model but fluctuates a lot more. A lot of peaks can be observed in the examples. The reason for this behavior is that the non-autoregressive model does not take into account the previous sampled value. The sampled value of the next quarter is not dependent on the sampled value of the previous quarter. This can lead to a large difference between these values which results in samples with a high variance. The mean of the samples of the non-autoregressive model, however, does not follow the trend of the real NRV as well as the autoregressive model. The mean stays in a narrow range around zero.
Some samples for the examples from the test set are visualized in Figure \ref{fig:linear_model_samples_comparison}. For the autoregressive model, the samples largely follow the trend of the real NRV while the non-autoregressive model has a lot of fluctuations and peaks. By visually looking at the samples themselves, the samples of the autoregressive model are more realistic than the samples of the non-autoregressive model. \\
Comparing the results from the autoregressive and non-autoregressive linear models, it is clear that the autoregressive model has lower MSE and MAE on the test set. The CRPS is, however, higher for the autoregressive model. The CRPS is calculated using the outputted quantiles while the MSE and MAE are calculated by sampling from the reconstructed distributions.
% TODO: Is this reasoning correct? + Explain the results more we see in the table (Weird results :( )
Because of error propagation in the autoregressive model, the outputted quantiles also contain more error which leads to a higher CRPS. The non-autoregressive model does not suffer from this problem. When comparing the examples from the autoregressive model in Figure \ref{fig:autoregressive_linear_model_samples} and the examples from the non-autoregressive model in Figure \ref{fig:non_autoregressive_linear_model_samples}, it can be seen that the non-autoregressive model has a higher variance in the samples. The confidence intervals are larger and have a lot more peaks. The autoregressive model examples are way more contained in the range of -500 to 500. Some full-day NRV samples are also compared in Figure \ref{fig:linear_model_sample_comparison}. The peaky behavior also appears in the samples from the non-autoregressive model. This is quite logical because the sampled value of the next quarter doesn't depend on the value sampled of the previous quarter. This explains why a lot of peaks can be observed. The autoregressive full-day NRV samples on the other hand, do depend on the previous sampled value. This leads to a smoother curve and fewer peaks.
\\\\
% figure with 2 models compared (left with 4 row examples and right with 4 row examples), autoregressive vs non-autoregressive
\begin{figure}[ht]
\centering
\begin{subfigure}[b]{0.49\textwidth}
@@ -217,33 +174,33 @@ Because of error propagation in the autoregressive model, the outputted quantile
\end{subfigure}
\begin{subfigure}[b]{0.49\textwidth}
\includegraphics[width=\textwidth]{images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP-QE-Example_4320_samples.png}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.49\textwidth}
\includegraphics[width=\textwidth]{images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Example_4320_samples.png}
\end{subfigure}
\begin{subfigure}[b]{0.49\textwidth}
\includegraphics[width=\textwidth]{images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP-QE-Example_6336_samples.png}
\caption{Autoregressive linear model}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.49\textwidth}
\includegraphics[width=\textwidth]{images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Example_6336_samples.png}
\includegraphics[width=\textwidth]{images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Example_4320_samples.png}
\caption{Non-autoregressive linear model}
\end{subfigure}
% \begin{subfigure}[b]{0.49\textwidth}
% \includegraphics[width=\textwidth]{images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP-QE-Example_7008_samples.png}
%
% \end{subfigure}
% \hfill
% \begin{subfigure}[b]{0.49\textwidth}
% \includegraphics[width=\textwidth]{images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Example_7008_samples.png}
% \end{subfigure}
\caption{Comparison of the autoregressive and non-autoregressive linear models samples. The plots show ten samples of the full-day NRV for the autoregressive and non-autoregressive linear models. The samples were generated using input features NRV, Load, Wind, PV, and the Net Position. The autoregressive model also uses the quarter embedding with 5 dimensions.}
\label{fig:linear_model_sample_comparison}
\caption{Samples for two examples from the test set for the autoregressive and non-autoregressive linear model. The real NRV is shown in orange.}
\label{fig:linear_model_samples_comparison}
\end{figure}
% TODO: Talk about the over/underestimation of the quantiles for the models. Plots have been made for this.
Another way to evaluate the performance of the models is to look at the over/underestimation of the quantiles. For each day and every quarter in the test set, the quantiles are predicted by the model. Then for every quantile, it is checked how many times the real NRV is below the predicted quantile. For example, for the 10\% quantile, around 10\% of the real NRV values should be below the predicted quantile. This can be plotted for every quantile. These can be seen in Figure \ref{fig:linear_model_quantile_over_underestimation}. The plots show the over/underestimation of the quantiles for the autoregressive and non-autoregressive linear models.
\begin{figure}[ht]
\centering
\begin{subfigure}[b]{0.49\textwidth}
\includegraphics[width=\textwidth]{images/quantile_regression/quantile_performance/AQR_Quantile_Performance_Training.jpeg}
\caption{Training set}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.49\textwidth}
\includegraphics[width=\textwidth]{images/quantile_regression/quantile_performance/AQR_Quantile_Performance_Test.jpeg}
\caption{Test set}
\end{subfigure}
\caption{Over/underestimation of the quantiles for the autoregressive and non-autoregressive linear models.}
\label{fig:linear_model_quantile_over_underestimation}
\end{figure}
\subsubsection{Non-linear Model}
In this context, a simple feedforward neural network is trained to predict the quantiles for the NRV. The quantiles are then used to reconstruct the cumulative distribution function (CDF) for the NRV of a quarter. Predictions for the NRV can then be sampled from this reconstructed CDF. The neural network is trained using the pinball loss function explained in section \ref{subsubsec:quantile_regression_training}.

Binary file not shown.

Binary file not shown.

Binary file not shown.

Binary file not shown.

Binary file not shown.

Binary file not shown.

View File

@@ -45,56 +45,37 @@
\abx@aux@cite{0}{dumas_deep_2022}
\abx@aux@segm{0}{0}{dumas_deep_2022}
\abx@aux@page{5}{19}
\@writefile{toc}{\contentsline {section}{\numberline {6}TODO: Better title for this section}{20}{section.6}\protected@file@percent }
\@writefile{toc}{\contentsline {section}{\numberline {7}Results \& Discussion}{20}{section.7}\protected@file@percent }
\@writefile{toc}{\contentsline {subsection}{\numberline {7.1}Data}{20}{subsection.7.1}\protected@file@percent }
\@writefile{toc}{\contentsline {subsubsection}{\numberline {7.1.1}Linear Model}{22}{subsubsection.7.1.1}\protected@file@percent }
\@writefile{lot}{\contentsline {table}{\numberline {3}{\ignorespaces Autoregressive linear model results\relax }}{22}{table.caption.9}\protected@file@percent }
\newlabel{tab:autoregressive_linear_model_baseline_results}{{3}{22}{Autoregressive linear model results\relax }{table.caption.9}{}}
\@writefile{toc}{\contentsline {section}{\numberline {6}Results \& Discussion}{20}{section.6}\protected@file@percent }
\@writefile{toc}{\contentsline {subsection}{\numberline {6.1}Data}{20}{subsection.6.1}\protected@file@percent }
\@writefile{toc}{\contentsline {subsubsection}{\numberline {6.1.1}Linear Model}{21}{subsubsection.6.1.1}\protected@file@percent }
\@writefile{lot}{\contentsline {table}{\numberline {3}{\ignorespaces Linear model results\relax }}{22}{table.caption.9}\protected@file@percent }
\newlabel{tab:linear_model_baseline_results}{{3}{22}{Linear model results\relax }{table.caption.9}{}}
\@writefile{lof}{\contentsline {figure}{\numberline {6}{\ignorespaces Mean and standard deviation of the NRV values over the quarter of the day\relax }}{23}{figure.caption.10}\protected@file@percent }
\newlabel{fig:nrv_mean_std_over_quarter}{{6}{23}{Mean and standard deviation of the NRV values over the quarter of the day\relax }{figure.caption.10}{}}
\@writefile{lot}{\contentsline {table}{\numberline {4}{\ignorespaces Autoregressive linear model results with time features\relax }}{24}{table.caption.11}\protected@file@percent }
\newlabel{tab:autoregressive_linear_model_quarter_embedding_baseline_results}{{4}{24}{Autoregressive linear model results with time features\relax }{table.caption.11}{}}
\newlabel{fig:autoregressive_linear_model_sample_1}{{7a}{25}{Sample 1\relax }{figure.caption.12}{}}
\newlabel{sub@fig:autoregressive_linear_model_sample_1}{{a}{25}{Sample 1\relax }{figure.caption.12}{}}
\newlabel{fig:autoregressive_linear_model_sample_2}{{7b}{25}{Sample 2\relax }{figure.caption.12}{}}
\newlabel{sub@fig:autoregressive_linear_model_sample_2}{{b}{25}{Sample 2\relax }{figure.caption.12}{}}
\newlabel{fig:autoregressive_linear_model_sample_3}{{7c}{25}{Sample 3\relax }{figure.caption.12}{}}
\newlabel{sub@fig:autoregressive_linear_model_sample_3}{{c}{25}{Sample 3\relax }{figure.caption.12}{}}
\newlabel{fig:autoregressive_linear_model_sample_4}{{7d}{25}{Sample 4\relax }{figure.caption.12}{}}
\newlabel{sub@fig:autoregressive_linear_model_sample_4}{{d}{25}{Sample 4\relax }{figure.caption.12}{}}
\@writefile{lof}{\contentsline {figure}{\numberline {7}{\ignorespaces Test examples of the autoregressive linear model. The plots show the confidence intervals calculated from 1000 generated full-day NRV samples. The samples were generated using input features NRV, Load, Wind, PV, Net Position and the quarter embedding.\relax }}{25}{figure.caption.12}\protected@file@percent }
\newlabel{fig:autoregressive_linear_model_samples}{{7}{25}{Test examples of the autoregressive linear model. The plots show the confidence intervals calculated from 1000 generated full-day NRV samples. The samples were generated using input features NRV, Load, Wind, PV, Net Position and the quarter embedding.\relax }{figure.caption.12}{}}
\@writefile{toc}{\contentsline {subsubsection}{\numberline {7.1.2}Non-linear Model}{25}{subsubsection.7.1.2}\protected@file@percent }
\@writefile{lot}{\contentsline {table}{\numberline {5}{\ignorespaces Non-Autoregressive linear model results\relax }}{26}{table.caption.13}\protected@file@percent }
\newlabel{tab:non_autoregressive_linear_model_baseline_results}{{5}{26}{Non-Autoregressive linear model results\relax }{table.caption.13}{}}
\newlabel{fig:non_autoregressive_linear_model_sample_1}{{8a}{27}{Sample 1\relax }{figure.caption.14}{}}
\newlabel{sub@fig:non_autoregressive_linear_model_sample_1}{{a}{27}{Sample 1\relax }{figure.caption.14}{}}
\newlabel{fig:non_autoregressive_linear_model_sample_2}{{8b}{27}{Sample 2\relax }{figure.caption.14}{}}
\newlabel{sub@fig:non_autoregressive_linear_model_sample_2}{{b}{27}{Sample 2\relax }{figure.caption.14}{}}
\newlabel{fig:non_autoregressive_linear_model_sample_3}{{8c}{27}{Sample 3\relax }{figure.caption.14}{}}
\newlabel{sub@fig:non_autoregressive_linear_model_sample_3}{{c}{27}{Sample 3\relax }{figure.caption.14}{}}
\newlabel{fig:non_autoregressive_linear_model_sample_4}{{8d}{27}{Sample 4\relax }{figure.caption.14}{}}
\newlabel{sub@fig:non_autoregressive_linear_model_sample_4}{{d}{27}{Sample 4\relax }{figure.caption.14}{}}
\@writefile{lof}{\contentsline {figure}{\numberline {8}{\ignorespaces Test examples of the non-autoregressive linear model. The plots show the confidence intervals calculated from 1000 generated full-day NRV samples. The samples were generated using input features NRV, Load, Wind, PV and the Net Position.\relax }}{27}{figure.caption.14}\protected@file@percent }
\newlabel{fig:non_autoregressive_linear_model_samples}{{8}{27}{Test examples of the non-autoregressive linear model. The plots show the confidence intervals calculated from 1000 generated full-day NRV samples. The samples were generated using input features NRV, Load, Wind, PV and the Net Position.\relax }{figure.caption.14}{}}
\@writefile{lot}{\contentsline {table}{\numberline {6}{\ignorespaces Non-linear Quantile Regression Model Architecture\relax }}{27}{table.caption.16}\protected@file@percent }
\newlabel{tab:non_linear_model_architecture}{{6}{27}{Non-linear Quantile Regression Model Architecture\relax }{table.caption.16}{}}
\@writefile{lof}{\contentsline {figure}{\numberline {9}{\ignorespaces Comparison of the autoregressive and non-autoregressive linear models samples. The plots show ten samples of the full-day NRV for the autoregressive and non-autoregressive linear models. The samples were generated using input features NRV, Load, Wind, PV, and the Net Position. The autoregressive model also uses the quarter embedding with 5 dimensions.\relax }}{28}{figure.caption.15}\protected@file@percent }
\newlabel{fig:linear_model_sample_comparison}{{9}{28}{Comparison of the autoregressive and non-autoregressive linear models samples. The plots show ten samples of the full-day NRV for the autoregressive and non-autoregressive linear models. The samples were generated using input features NRV, Load, Wind, PV, and the Net Position. The autoregressive model also uses the quarter embedding with 5 dimensions.\relax }{figure.caption.15}{}}
\@writefile{lot}{\contentsline {table}{\numberline {7}{\ignorespaces Autoregressive non-linear quantile regression model results. All the models used a dropout of 0.2 .\relax }}{28}{table.caption.17}\protected@file@percent }
\newlabel{tab:autoregressive_non_linear_model_results}{{7}{28}{Autoregressive non-linear quantile regression model results. All the models used a dropout of 0.2 .\relax }{table.caption.17}{}}
\@writefile{lof}{\contentsline {figure}{\numberline {10}{\ignorespaces Comparison for examples from test set between the autoregressive linear and non-linear models. The plots show the confidence intervals calculated from 1000 generated full-day NRV samples. The samples were generated using input features NRV, Load, Wind, PV, Net Position and the quarter embedding. The non-linear model used 8 layers with a hidden size of 256 and a dropout rate of 0.2.\relax }}{29}{figure.caption.18}\protected@file@percent }
\newlabel{fig:linear_non_linear_sample_comparison}{{10}{29}{Comparison for examples from test set between the autoregressive linear and non-linear models. The plots show the confidence intervals calculated from 1000 generated full-day NRV samples. The samples were generated using input features NRV, Load, Wind, PV, Net Position and the quarter embedding. The non-linear model used 8 layers with a hidden size of 256 and a dropout rate of 0.2.\relax }{figure.caption.18}{}}
\@writefile{toc}{\contentsline {subsubsection}{\numberline {7.1.3}GRU Model}{30}{subsubsection.7.1.3}\protected@file@percent }
\@writefile{lot}{\contentsline {table}{\numberline {8}{\ignorespaces GRU Model Architecture\relax }}{30}{table.caption.19}\protected@file@percent }
\newlabel{tab:gru_model_architecture}{{8}{30}{GRU Model Architecture\relax }{table.caption.19}{}}
\@writefile{lot}{\contentsline {table}{\numberline {9}{\ignorespaces Autoregressive GRU quantile regression model results. All the models used a dropout of 0.2 .\relax }}{31}{table.caption.20}\protected@file@percent }
\newlabel{tab:autoregressive_gru_model_results}{{9}{31}{Autoregressive GRU quantile regression model results. All the models used a dropout of 0.2 .\relax }{table.caption.20}{}}
\@writefile{toc}{\contentsline {subsection}{\numberline {7.2}Diffusion}{32}{subsection.7.2}\protected@file@percent }
\@writefile{toc}{\contentsline {section}{\numberline {8}Policies for battery optimization}{32}{section.8}\protected@file@percent }
\@writefile{toc}{\contentsline {subsection}{\numberline {8.1}Baselines}{32}{subsection.8.1}\protected@file@percent }
\@writefile{toc}{\contentsline {subsection}{\numberline {8.2}Policies using NRV predictions}{32}{subsection.8.2}\protected@file@percent }
\@writefile{lof}{\contentsline {figure}{\numberline {7}{\ignorespaces Comparison of the autoregressive and non-autoregressive linear model samples.\relax }}{25}{figure.caption.12}\protected@file@percent }
\newlabel{fig:linear_model_sample_comparison}{{7}{25}{Comparison of the autoregressive and non-autoregressive linear model samples.\relax }{figure.caption.12}{}}
\@writefile{lof}{\contentsline {figure}{\numberline {8}{\ignorespaces Samples for two examples from the test set for the autoregressive and non-autoregressive linear model. The real NRV is shown in orange.\relax }}{26}{figure.caption.13}\protected@file@percent }
\newlabel{fig:linear_model_samples_comparison}{{8}{26}{Samples for two examples from the test set for the autoregressive and non-autoregressive linear model. The real NRV is shown in orange.\relax }{figure.caption.13}{}}
\@writefile{toc}{\contentsline {subsubsection}{\numberline {6.1.2}Non-linear Model}{26}{subsubsection.6.1.2}\protected@file@percent }
\@writefile{lof}{\contentsline {figure}{\numberline {9}{\ignorespaces Over/underestimation of the quantiles for the autoregressive and non-autoregressive linear models.\relax }}{27}{figure.caption.14}\protected@file@percent }
\newlabel{fig:linear_model_quantile_over_underestimation}{{9}{27}{Over/underestimation of the quantiles for the autoregressive and non-autoregressive linear models.\relax }{figure.caption.14}{}}
\@writefile{lot}{\contentsline {table}{\numberline {5}{\ignorespaces Non-linear Quantile Regression Model Architecture\relax }}{28}{table.caption.15}\protected@file@percent }
\newlabel{tab:non_linear_model_architecture}{{5}{28}{Non-linear Quantile Regression Model Architecture\relax }{table.caption.15}{}}
\@writefile{lot}{\contentsline {table}{\numberline {6}{\ignorespaces Autoregressive non-linear quantile regression model results. All the models used a dropout of 0.2 .\relax }}{28}{table.caption.16}\protected@file@percent }
\newlabel{tab:autoregressive_non_linear_model_results}{{6}{28}{Autoregressive non-linear quantile regression model results. All the models used a dropout of 0.2 .\relax }{table.caption.16}{}}
\@writefile{lof}{\contentsline {figure}{\numberline {10}{\ignorespaces Comparison for examples from test set between the autoregressive linear and non-linear models. The plots show the confidence intervals calculated from 1000 generated full-day NRV samples. The samples were generated using input features NRV, Load, Wind, PV, Net Position and the quarter embedding. The non-linear model used 8 layers with a hidden size of 256 and a dropout rate of 0.2.\relax }}{29}{figure.caption.17}\protected@file@percent }
\newlabel{fig:linear_non_linear_sample_comparison}{{10}{29}{Comparison for examples from test set between the autoregressive linear and non-linear models. The plots show the confidence intervals calculated from 1000 generated full-day NRV samples. The samples were generated using input features NRV, Load, Wind, PV, Net Position and the quarter embedding. The non-linear model used 8 layers with a hidden size of 256 and a dropout rate of 0.2.\relax }{figure.caption.17}{}}
\@writefile{toc}{\contentsline {subsubsection}{\numberline {6.1.3}GRU Model}{30}{subsubsection.6.1.3}\protected@file@percent }
\@writefile{lot}{\contentsline {table}{\numberline {7}{\ignorespaces GRU Model Architecture\relax }}{30}{table.caption.18}\protected@file@percent }
\newlabel{tab:gru_model_architecture}{{7}{30}{GRU Model Architecture\relax }{table.caption.18}{}}
\@writefile{lot}{\contentsline {table}{\numberline {8}{\ignorespaces Autoregressive GRU quantile regression model results. All the models used a dropout of 0.2 .\relax }}{31}{table.caption.19}\protected@file@percent }
\newlabel{tab:autoregressive_gru_model_results}{{8}{31}{Autoregressive GRU quantile regression model results. All the models used a dropout of 0.2 .\relax }{table.caption.19}{}}
\@writefile{toc}{\contentsline {subsection}{\numberline {6.2}Diffusion}{32}{subsection.6.2}\protected@file@percent }
\@writefile{toc}{\contentsline {section}{\numberline {7}Policies for battery optimization}{32}{section.7}\protected@file@percent }
\@writefile{toc}{\contentsline {subsection}{\numberline {7.1}Baselines}{32}{subsection.7.1}\protected@file@percent }
\@writefile{toc}{\contentsline {subsection}{\numberline {7.2}Policies using NRV predictions}{32}{subsection.7.2}\protected@file@percent }
\abx@aux@page{6}{33}
\abx@aux@page{7}{33}
\abx@aux@page{8}{33}

View File

@@ -1,4 +1,4 @@
This is pdfTeX, Version 3.141592653-2.6-1.40.25 (TeX Live 2023) (preloaded format=pdflatex 2023.9.17) 3 MAY 2024 17:59
This is pdfTeX, Version 3.141592653-2.6-1.40.25 (TeX Live 2023) (preloaded format=pdflatex 2023.9.17) 4 MAY 2024 13:43
entering extended mode
restricted \write18 enabled.
file:line:error style messages enabled.
@@ -1029,7 +1029,7 @@ LaTeX Font Info: Font shape `T1/LinuxBiolinumT-TLF/m/n' will be
pdfTeX warning: pdflatex (file ./ea-en.pdf): PDF inclusion: found PDF version <1.7>, but at most version <1.5> allowed
<ea-en.pdf, id=124, 192.05753pt x 64.01918pt>
<ea-en.pdf, id=120, 192.05753pt x 64.01918pt>
File: ea-en.pdf Graphic file (type pdf)
<use ea-en.pdf>
Package pdftex.def Info: ea-en.pdf used on input line 135.
@@ -1105,7 +1105,7 @@ Overfull \hbox (33.0pt too wide) in paragraph at lines 135--135
pdfTeX warning: pdflatex (file ./ugent-en.pdf): PDF inclusion: found PDF version <1.7>, but at most version <1.5> allowed
<ugent-en.pdf, id=125, 106.69862pt x 85.3589pt>
<ugent-en.pdf, id=121, 106.69862pt x 85.3589pt>
File: ugent-en.pdf Graphic file (type pdf)
<use ugent-en.pdf>
Package pdftex.def Info: ugent-en.pdf used on input line 135.
@@ -1166,13 +1166,13 @@ LaTeX Font Info: Font shape `TS1/LinuxLibertineT-TLF/m/n' will be
[5{/usr/local/texlive/2023/texmf-dist/fonts/enc/dvips/libertinust1math/libusMI.enc}]
LaTeX Font Info: Font shape `T1/LinuxBiolinumT-TLF/m/n' will be
(Font) scaled to size 14.4pt on input line 100.
<images/quantile_regression/cdf_quantiles_example.png, id=197, 722.7pt x 433.62pt>
<images/quantile_regression/cdf_quantiles_example.png, id=192, 722.7pt x 433.62pt>
File: images/quantile_regression/cdf_quantiles_example.png Graphic file (type png)
<use images/quantile_regression/cdf_quantiles_example.png>
Package pdftex.def Info: images/quantile_regression/cdf_quantiles_example.png used on input line 107.
(pdftex.def) Requested size: 364.19667pt x 218.51653pt.
[6{/usr/local/texlive/2023/texmf-dist/fonts/enc/dvips/libertine/lbtn_naooyc.enc} <./images/quantile_regression/cdf_quantiles_example.png>]
<images/quantile_regression/reconstructed_cdf.png, id=209, 722.7pt x 433.62pt>
<images/quantile_regression/reconstructed_cdf.png, id=204, 722.7pt x 433.62pt>
File: images/quantile_regression/reconstructed_cdf.png Graphic file (type png)
<use images/quantile_regression/reconstructed_cdf.png>
Package pdftex.def Info: images/quantile_regression/reconstructed_cdf.png used on input line 117.
@@ -1181,40 +1181,40 @@ LaTeX Font Info: Font shape `T1/LinuxLibertineT-TLF/m/n' will be
(Font) scaled to size 8.0pt on input line 127.
LaTeX Font Info: Font shape `T1/LinuxLibertineT-TLF/m/n' will be
(Font) scaled to size 6.0pt on input line 127.
[7{/usr/local/texlive/2023/texmf-dist/fonts/enc/dvips/libertinust1math/libusMR.enc}{/usr/local/texlive/2023/texmf-dist/fonts/enc/dvips/libertinust1math/libusEX.enc}{/usr/local/texlive/2023/texmf-dist/fonts/enc/dvips/libertinust1math/libusSYM.enc} <./images/quantile_regression/reconstructed_cdf.png>] [8] [9]
<images/quantile_regression/rnn/RNN_diagram.png, id=230, 753.81625pt x 324.21124pt>
[7{/usr/local/texlive/2023/texmf-dist/fonts/enc/dvips/libertinust1math/libusMR.enc}{/usr/local/texlive/2023/texmf-dist/fonts/enc/dvips/libertinust1math/libusEX.enc}{/usr/local/texlive/2023/texmf-dist/fonts/enc/dvips/libertinust1math/libusSYM.enc} <./images/quantile_regression/reconstructed_cdf.png>] [8] [9] [10]
<images/quantile_regression/rnn/RNN_diagram.png, id=229, 753.81625pt x 324.21124pt>
File: images/quantile_regression/rnn/RNN_diagram.png Graphic file (type png)
<use images/quantile_regression/rnn/RNN_diagram.png>
Package pdftex.def Info: images/quantile_regression/rnn/RNN_diagram.png used on input line 204.
Package pdftex.def Info: images/quantile_regression/rnn/RNN_diagram.png used on input line 206.
(pdftex.def) Requested size: 364.19667pt x 156.63872pt.
[10] [11 <./images/quantile_regression/rnn/RNN_diagram.png>]
<images/diffusion/Generation-with-Diffusion-Models.png, id=242, 926.00159pt x 228.96758pt>
[11 <./images/quantile_regression/rnn/RNN_diagram.png>]
<images/diffusion/Generation-with-Diffusion-Models.png, id=237, 926.00159pt x 228.96758pt>
File: images/diffusion/Generation-with-Diffusion-Models.png Graphic file (type png)
<use images/diffusion/Generation-with-Diffusion-Models.png>
Package pdftex.def Info: images/diffusion/Generation-with-Diffusion-Models.png used on input line 232.
Package pdftex.def Info: images/diffusion/Generation-with-Diffusion-Models.png used on input line 234.
(pdftex.def) Requested size: 364.19667pt x 90.05513pt.
[12 <./images/diffusion/Generation-with-Diffusion-Models.png>] [13{/usr/local/texlive/2023/texmf-dist/fonts/enc/dvips/libertinust1math/libusBMR.enc}{/usr/local/texlive/2023/texmf-dist/fonts/enc/dvips/libertinust1math/libusBB.enc}]
Package caption Warning: \label without proper reference on input line 279.
Package caption Warning: \label without proper reference on input line 281.
See the caption package documentation for explanation.
LaTeX Warning: Reference `fig:diffusion_process' on page 14 undefined on input line 272.
LaTeX Warning: Reference `fig:diffusion_process' on page 14 undefined on input line 274.
<images/diffusion/diffusion_graphical_model.png, id=257, 979.66pt x 185.69376pt>
<images/diffusion/diffusion_graphical_model.png, id=252, 979.66pt x 185.69376pt>
File: images/diffusion/diffusion_graphical_model.png Graphic file (type png)
<use images/diffusion/diffusion_graphical_model.png>
Package pdftex.def Info: images/diffusion/diffusion_graphical_model.png used on input line 276.
Package pdftex.def Info: images/diffusion/diffusion_graphical_model.png used on input line 278.
(pdftex.def) Requested size: 364.19667pt x 69.03145pt.
[14 <./images/diffusion/diffusion_graphical_model.png>]
LaTeX Font Info: Trying to load font information for U+bbm on input line 305.
LaTeX Font Info: Trying to load font information for U+bbm on input line 307.
(/usr/local/texlive/2023/texmf-dist/tex/latex/bbm-macros/ubbm.fd
File: ubbm.fd 1999/03/15 V 1.2 Font definition for bbm font - TH
)
<images/quantile_regression/crps_visualization.png, id=267, 611.4042pt x 395.3169pt>
<images/quantile_regression/crps_visualization.png, id=262, 611.4042pt x 395.3169pt>
File: images/quantile_regression/crps_visualization.png Graphic file (type png)
<use images/quantile_regression/crps_visualization.png>
Package pdftex.def Info: images/quantile_regression/crps_visualization.png used on input line 323.
Package pdftex.def Info: images/quantile_regression/crps_visualization.png used on input line 325.
(pdftex.def) Requested size: 364.19667pt x 235.4849pt.
) [15 <./images/quantile_regression/crps_visualization.png>]
\openout2 = `sections/policies.aux'.
@@ -1234,196 +1234,169 @@ LaTeX Warning: Citation 'rasul_autoregressive_2021' on page 18 undefined on inpu
]) [19] (./sections/nrv_prediction.tex [20
]) [19] (./sections/results.tex [20
]
Overfull \hbox (23.14783pt too wide) in paragraph at lines 50--66
[][]
[]
Underfull \hbox (badness 10000) in paragraph at lines 45--69
[]
[21]
<images/quantile_regression/nrv_mean_std_over_quarter.png, id=313, 722.7pt x 433.62pt>
] [21] [22]
<images/quantile_regression/nrv_mean_std_over_quarter.png, id=312, 722.7pt x 433.62pt>
File: images/quantile_regression/nrv_mean_std_over_quarter.png Graphic file (type png)
<use images/quantile_regression/nrv_mean_std_over_quarter.png>
Package pdftex.def Info: images/quantile_regression/nrv_mean_std_over_quarter.png used on input line 74.
Package pdftex.def Info: images/quantile_regression/nrv_mean_std_over_quarter.png used on input line 84.
(pdftex.def) Requested size: 455.24411pt x 273.14896pt.
[23 <./images/quantile_regression/nrv_mean_std_over_quarter.png>]
Overfull \hbox (23.14783pt too wide) in paragraph at lines 91--109
[][]
[]
LaTeX Warning: Reference `fig:autoregressive_linear_model_samples' on page 24 undefined on input line 123.
Underfull \hbox (badness 10000) in paragraph at lines 85--112
[]
[22]
<images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_864.png, id=323, 1180.8918pt x 595.5048pt>
<images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_864.png, id=320, 1180.8918pt x 595.5048pt>
File: images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_864.png Graphic file (type png)
<use images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_864.png>
Package pdftex.def Info: images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_864.png used on input line 119.
Package pdftex.def Info: images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_864.png used on input line 128.
(pdftex.def) Requested size: 223.07211pt x 112.49284pt.
LaTeX Font Info: Font shape `T1/LinuxLibertineT-TLF/m/n' will be
(Font) scaled to size 10.95pt on input line 120.
<images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_4320.png, id=324, 1180.8918pt x 595.5048pt>
<images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_864.png, id=321, 1180.8918pt x 595.5048pt>
File: images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_864.png Graphic file (type png)
<use images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_864.png>
Package pdftex.def Info: images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_864.png used on input line 132.
(pdftex.def) Requested size: 223.07211pt x 112.49284pt.
<images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_4320.png, id=322, 1180.8918pt x 595.5048pt>
File: images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_4320.png Graphic file (type png)
<use images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_4320.png>
Package pdftex.def Info: images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_4320.png used on input line 125.
Package pdftex.def Info: images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_4320.png used on input line 135.
(pdftex.def) Requested size: 223.07211pt x 112.49284pt.
<images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_6336.png, id=325, 1180.8918pt x 595.5048pt>
<images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_4320.png, id=323, 1180.8918pt x 595.5048pt>
File: images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_4320.png Graphic file (type png)
<use images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_4320.png>
Package pdftex.def Info: images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_4320.png used on input line 139.
(pdftex.def) Requested size: 223.07211pt x 112.49284pt.
<images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_6336.png, id=324, 1180.8918pt x 595.5048pt>
File: images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_6336.png Graphic file (type png)
<use images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_6336.png>
Package pdftex.def Info: images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_6336.png used on input line 131.
Package pdftex.def Info: images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_6336.png used on input line 142.
(pdftex.def) Requested size: 223.07211pt x 112.49284pt.
<images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_6336.png, id=325, 1180.8918pt x 595.5048pt>
File: images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_6336.png Graphic file (type png)
<use images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_6336.png>
Package pdftex.def Info: images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_6336.png used on input line 146.
(pdftex.def) Requested size: 223.07211pt x 112.49284pt.
<images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_7008.png, id=326, 1180.8918pt x 595.5048pt>
File: images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_7008.png Graphic file (type png)
<use images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_7008.png>
Package pdftex.def Info: images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_7008.png used on input line 137.
Package pdftex.def Info: images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_7008.png used on input line 149.
(pdftex.def) Requested size: 223.07211pt x 112.49284pt.
Underfull \hbox (badness 10000) in paragraph at lines 145--151
[]
Underfull \hbox (badness 10000) in paragraph at lines 145--151
[]
[23 <./images/quantile_regression/nrv_mean_std_over_quarter.png>]
<images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_864.png, id=338, 1180.8918pt x 595.5048pt>
File: images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_864.png Graphic file (type png)
<use images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_864.png>
Package pdftex.def Info: images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_864.png used on input line 177.
(pdftex.def) Requested size: 223.07211pt x 112.49284pt.
<images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_4320.png, id=339, 1180.8918pt x 595.5048pt>
File: images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_4320.png Graphic file (type png)
<use images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_4320.png>
Package pdftex.def Info: images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_4320.png used on input line 183.
(pdftex.def) Requested size: 223.07211pt x 112.49284pt.
<images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_6336.png, id=340, 1180.8918pt x 595.5048pt>
File: images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_6336.png Graphic file (type png)
<use images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_6336.png>
Package pdftex.def Info: images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_6336.png used on input line 189.
(pdftex.def) Requested size: 223.07211pt x 112.49284pt.
<images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_7008.png, id=341, 1180.8918pt x 595.5048pt>
LaTeX Font Info: Font shape `T1/LinuxLibertineT-TLF/m/n' will be
(Font) scaled to size 10.95pt on input line 150.
<images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_7008.png, id=327, 1180.8918pt x 595.5048pt>
File: images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_7008.png Graphic file (type png)
<use images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_7008.png>
Package pdftex.def Info: images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_7008.png used on input line 195.
Package pdftex.def Info: images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_7008.png used on input line 154.
(pdftex.def) Requested size: 223.07211pt x 112.49284pt.
<images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP-QE-Example_864_samples.png, id=345, 1180.8918pt x 595.5048pt>
[24] [25 <./images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_864.png> <./images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_864.png> <./images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_4320.png> <./images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_4320.png> <./images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_6336.png> <./images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_6336.png> <./images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_7008.png> <./images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_7008.png>]
Overfull \hbox (11.8445pt too wide) in paragraph at lines 164--165
\T1/LinuxLibertineT-TLF/m/n/12 sam-ples of the au-tore-gres-sive model are more re-al-is-tic than the sam-ples of the non-autoregressive
[]
Underfull \hbox (badness 10000) in paragraph at lines 164--165
[]
<images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP-QE-Example_864_samples.png, id=350, 1180.8918pt x 595.5048pt>
File: images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP-QE-Example_864_samples.png Graphic file (type png)
<use images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP-QE-Example_864_samples.png>
Package pdftex.def Info: images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP-QE-Example_864_samples.png used on input line 212.
Package pdftex.def Info: images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP-QE-Example_864_samples.png used on input line 169.
(pdftex.def) Requested size: 223.07211pt x 112.49284pt.
<images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Example_864_samples.png, id=346, 1180.8918pt x 595.5048pt>
<images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Example_864_samples.png, id=351, 1180.8918pt x 595.5048pt>
File: images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Example_864_samples.png Graphic file (type png)
<use images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Example_864_samples.png>
Package pdftex.def Info: images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Example_864_samples.png used on input line 216.
Package pdftex.def Info: images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Example_864_samples.png used on input line 173.
(pdftex.def) Requested size: 223.07211pt x 112.49284pt.
<images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP-QE-Example_4320_samples.png, id=347, 1180.8918pt x 595.5048pt>
<images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP-QE-Example_4320_samples.png, id=352, 1180.8918pt x 595.5048pt>
File: images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP-QE-Example_4320_samples.png Graphic file (type png)
<use images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP-QE-Example_4320_samples.png>
Package pdftex.def Info: images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP-QE-Example_4320_samples.png used on input line 219.
Package pdftex.def Info: images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP-QE-Example_4320_samples.png used on input line 176.
(pdftex.def) Requested size: 223.07211pt x 112.49284pt.
<images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Example_4320_samples.png, id=348, 1180.8918pt x 595.5048pt>
<images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Example_4320_samples.png, id=353, 1180.8918pt x 595.5048pt>
File: images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Example_4320_samples.png Graphic file (type png)
<use images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Example_4320_samples.png>
Package pdftex.def Info: images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Example_4320_samples.png used on input line 223.
(pdftex.def) Requested size: 223.07211pt x 112.49284pt.
<images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP-QE-Example_6336_samples.png, id=349, 1180.8918pt x 595.5048pt>
File: images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP-QE-Example_6336_samples.png Graphic file (type png)
<use images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP-QE-Example_6336_samples.png>
Package pdftex.def Info: images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP-QE-Example_6336_samples.png used on input line 226.
(pdftex.def) Requested size: 223.07211pt x 112.49284pt.
<images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Example_6336_samples.png, id=350, 1180.8918pt x 595.5048pt>
File: images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Example_6336_samples.png Graphic file (type png)
<use images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Example_6336_samples.png>
Package pdftex.def Info: images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Example_6336_samples.png used on input line 231.
Package pdftex.def Info: images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Example_4320_samples.png used on input line 181.
(pdftex.def) Requested size: 223.07211pt x 112.49284pt.
<images/quantile_regression/quantile_performance/AQR_Quantile_Performance_Training.jpeg, id=355, 883.8621pt x 609.9588pt>
File: images/quantile_regression/quantile_performance/AQR_Quantile_Performance_Training.jpeg Graphic file (type jpg)
<use images/quantile_regression/quantile_performance/AQR_Quantile_Performance_Training.jpeg>
Package pdftex.def Info: images/quantile_regression/quantile_performance/AQR_Quantile_Performance_Training.jpeg used on input line 193.
(pdftex.def) Requested size: 223.07211pt x 153.94125pt.
<images/quantile_regression/quantile_performance/AQR_Quantile_Performance_Test.jpeg, id=356, 883.8621pt x 609.9588pt>
File: images/quantile_regression/quantile_performance/AQR_Quantile_Performance_Test.jpeg Graphic file (type jpg)
<use images/quantile_regression/quantile_performance/AQR_Quantile_Performance_Test.jpeg>
Package pdftex.def Info: images/quantile_regression/quantile_performance/AQR_Quantile_Performance_Test.jpeg used on input line 198.
(pdftex.def) Requested size: 223.07211pt x 153.94125pt.
Underfull \hbox (badness 10000) in paragraph at lines 204--247
LaTeX Warning: Reference `subsubsec:quantile_regression_training' on page 26 undefined on input line 206.
Underfull \hbox (badness 10000) in paragraph at lines 206--210
[]
[24]
LaTeX Warning: Reference `subsubsec:quantile_regression_training' on page 25 undefined on input line 249.
Underfull \hbox (badness 10000) in paragraph at lines 249--253
[]
[25 <./images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_864.png> <./images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_4320.png> <./images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_6336.png> <./images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_7008.png>]
Underfull \hbox (badness 10000) in paragraph at lines 258--279
[26 <./images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP-QE-Example_864_samples.png> <./images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Example_864_samples.png> <./images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP-QE-Example_4320_samples.png> <./images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Example_4320_samples.png>]
Underfull \hbox (badness 10000) in paragraph at lines 215--236
[]
Underfull \hbox (badness 10000) in paragraph at lines 258--279
Underfull \hbox (badness 10000) in paragraph at lines 215--236
[]
[26] [27{/usr/local/texlive/2023/texmf-dist/fonts/enc/dvips/libertine/lbtn_7grukw.enc} <./images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_864.png> <./images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_4320.png> <./images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_6336.png> <./images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Sample_7008.png>]
Overfull \vbox (101.81699pt too high) has occurred while \output is active []
[28 <./images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP-QE-Example_864_samples.png> <./images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Example_864_samples.png> <./images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP-QE-Example_4320_samples.png> <./images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Example_4320_samples.png> <./images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP-QE-Example_6336_samples.png> <./images/quantile_regression/naqr_linear_model_samples/NAQR_NRV_Load_Wind_PV_NP-Example_6336_samples.png>]
[27 <./images/quantile_regression/quantile_performance/AQR_Quantile_Performance_Training.jpeg> <./images/quantile_regression/quantile_performance/AQR_Quantile_Performance_Test.jpeg>] [28{/usr/local/texlive/2023/texmf-dist/fonts/enc/dvips/libertine/lbtn_7grukw.enc}]
File: images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_864.png Graphic file (type png)
<use images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_864.png>
Package pdftex.def Info: images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_864.png used on input line 322.
Package pdftex.def Info: images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_864.png used on input line 279.
(pdftex.def) Requested size: 223.07211pt x 112.49284pt.
<images/quantile_regression/aqr_non_linear_model_samples/AQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_864.png, id=395, 1180.8918pt x 595.5048pt>
<images/quantile_regression/aqr_non_linear_model_samples/AQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_864.png, id=381, 1180.8918pt x 595.5048pt>
File: images/quantile_regression/aqr_non_linear_model_samples/AQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_864.png Graphic file (type png)
<use images/quantile_regression/aqr_non_linear_model_samples/AQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_864.png>
Package pdftex.def Info: images/quantile_regression/aqr_non_linear_model_samples/AQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_864.png used on input line 326.
Package pdftex.def Info: images/quantile_regression/aqr_non_linear_model_samples/AQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_864.png used on input line 283.
(pdftex.def) Requested size: 223.07211pt x 112.49284pt.
File: images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_4320.png Graphic file (type png)
<use images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_4320.png>
Package pdftex.def Info: images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_4320.png used on input line 329.
Package pdftex.def Info: images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_4320.png used on input line 286.
(pdftex.def) Requested size: 223.07211pt x 112.49284pt.
<images/quantile_regression/aqr_non_linear_model_samples/AQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_4320.png, id=396, 1180.8918pt x 595.5048pt>
<images/quantile_regression/aqr_non_linear_model_samples/AQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_4320.png, id=382, 1180.8918pt x 595.5048pt>
File: images/quantile_regression/aqr_non_linear_model_samples/AQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_4320.png Graphic file (type png)
<use images/quantile_regression/aqr_non_linear_model_samples/AQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_4320.png>
Package pdftex.def Info: images/quantile_regression/aqr_non_linear_model_samples/AQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_4320.png used on input line 333.
Package pdftex.def Info: images/quantile_regression/aqr_non_linear_model_samples/AQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_4320.png used on input line 290.
(pdftex.def) Requested size: 223.07211pt x 112.49284pt.
File: images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_6336.png Graphic file (type png)
<use images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_6336.png>
Package pdftex.def Info: images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_6336.png used on input line 336.
Package pdftex.def Info: images/quantile_regression/aqr_linear_model_samples/AQR_NRV_Load_Wind_PV_NP_QE-Sample_6336.png used on input line 293.
(pdftex.def) Requested size: 223.07211pt x 112.49284pt.
<images/quantile_regression/aqr_non_linear_model_samples/AQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_6336.png, id=397, 1180.8918pt x 595.5048pt>
<images/quantile_regression/aqr_non_linear_model_samples/AQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_6336.png, id=383, 1180.8918pt x 595.5048pt>
File: images/quantile_regression/aqr_non_linear_model_samples/AQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_6336.png Graphic file (type png)
<use images/quantile_regression/aqr_non_linear_model_samples/AQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_6336.png>
Package pdftex.def Info: images/quantile_regression/aqr_non_linear_model_samples/AQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_6336.png used on input line 341.
Package pdftex.def Info: images/quantile_regression/aqr_non_linear_model_samples/AQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_6336.png used on input line 298.
(pdftex.def) Requested size: 223.07211pt x 112.49284pt.
[29 <./images/quantile_regression/aqr_non_linear_model_samples/AQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_864.png> <./images/quantile_regression/aqr_non_linear_model_samples/AQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_4320.png> <./images/quantile_regression/aqr_non_linear_model_samples/AQR_NL_NRV_Load_Wind_PV_NP_QE-Sample_6336.png>] [30] [31]
Underfull \hbox (badness 10000) in paragraph at lines 427--435
Underfull \hbox (badness 10000) in paragraph at lines 384--392
[]
Underfull \hbox (badness 10000) in paragraph at lines 427--435
Underfull \hbox (badness 10000) in paragraph at lines 384--392
[]
Underfull \hbox (badness 10000) in paragraph at lines 427--435
Underfull \hbox (badness 10000) in paragraph at lines 384--392
[]
Underfull \hbox (badness 10000) in paragraph at lines 427--435
Underfull \hbox (badness 10000) in paragraph at lines 384--392
[]
Underfull \hbox (badness 10000) in paragraph at lines 427--435
Underfull \hbox (badness 10000) in paragraph at lines 384--392
[]
@@ -1432,7 +1405,7 @@ Underfull \hbox (badness 10000) in paragraph at lines 427--435
LaTeX Warning: There were undefined references.
Package rerunfilecheck Info: File `verslag.out' has not changed.
(rerunfilecheck) Checksum: C706F3FF5465D88DFF2FD800E01FDA3B;4583.
(rerunfilecheck) Checksum: 8EB8242E73CD308988F7647F86CC97BB;4349.
Package biblatex Warning: Please (re)run Biber on the file:
(biblatex) verslag
@@ -1443,18 +1416,18 @@ Package logreq Info: Writing requests to 'verslag.run.xml'.
)
Here is how much of TeX's memory you used:
26903 strings out of 476025
491570 string characters out of 5790017
26886 strings out of 476025
490528 string characters out of 5790017
1883388 words of memory out of 5000000
46807 multiletter control sequences out of 15000+600000
46790 multiletter control sequences out of 15000+600000
603223 words of font info for 88 fonts, out of 8000000 for 9000
1141 hyphenation exceptions out of 8191
83i,16n,131p,2100b,5180s stack positions out of 10000i,1000n,20000p,200000b,200000s
</Users/victormylle/Library/texlive/2023/texmf-var/fonts/pk/ljfour/public/bbm/bbm12.600pk></usr/local/texlive/2023/texmf-dist/fonts/type1/public/libertinust1math/LibertinusT1Math.pfb></usr/local/texlive/2023/texmf-dist/fonts/type1/public/libertine/LinBiolinumT.pfb></usr/local/texlive/2023/texmf-dist/fonts/type1/public/libertine/LinBiolinumTB.pfb></usr/local/texlive/2023/texmf-dist/fonts/type1/public/libertine/LinLibertineT.pfb></usr/local/texlive/2023/texmf-dist/fonts/type1/public/libertine/LinLibertineTB.pfb></usr/local/texlive/2023/texmf-dist/fonts/type1/public/libertine/LinLibertineTI.pfb></usr/local/texlive/2023/texmf-dist/fonts/type1/public/stix/stix-mathcal.pfb>
Output written on verslag.pdf (34 pages, 5396984 bytes).
Output written on verslag.pdf (34 pages, 5119691 bytes).
PDF statistics:
517 PDF objects out of 1000 (max. 8388607)
404 compressed objects within 5 object streams
96 named destinations out of 1000 (max. 500000)
371 words of extra memory for PDF output out of 10000 (max. 10000000)
502 PDF objects out of 1000 (max. 8388607)
392 compressed objects within 4 object streams
94 named destinations out of 1000 (max. 500000)
363 words of extra memory for PDF output out of 10000 (max. 10000000)

View File

@@ -18,13 +18,12 @@
\BOOKMARK [1][-]{section.5}{\376\377\000L\000i\000t\000e\000r\000a\000t\000u\000r\000e\000\040\000S\000t\000u\000d\000y}{}% 18
\BOOKMARK [2][-]{subsection.5.1}{\376\377\000E\000l\000e\000c\000t\000r\000i\000c\000i\000t\000y\000\040\000P\000r\000i\000c\000e\000\040\000F\000o\000r\000e\000c\000a\000s\000t\000i\000n\000g}{section.5}% 19
\BOOKMARK [2][-]{subsection.5.2}{\376\377\000P\000o\000l\000i\000c\000i\000e\000s\000\040\000f\000o\000r\000\040\000B\000a\000t\000t\000e\000r\000y\000\040\000O\000p\000t\000i\000m\000i\000z\000a\000t\000i\000o\000n}{section.5}% 20
\BOOKMARK [1][-]{section.6}{\376\377\000T\000O\000D\000O\000:\000\040\000B\000e\000t\000t\000e\000r\000\040\000t\000i\000t\000l\000e\000\040\000f\000o\000r\000\040\000t\000h\000i\000s\000\040\000s\000e\000c\000t\000i\000o\000n}{}% 21
\BOOKMARK [1][-]{section.7}{\376\377\000R\000e\000s\000u\000l\000t\000s\000\040\000\046\000\040\000D\000i\000s\000c\000u\000s\000s\000i\000o\000n}{}% 22
\BOOKMARK [2][-]{subsection.7.1}{\376\377\000D\000a\000t\000a}{section.7}% 23
\BOOKMARK [3][-]{subsubsection.7.1.1}{\376\377\000L\000i\000n\000e\000a\000r\000\040\000M\000o\000d\000e\000l}{subsection.7.1}% 24
\BOOKMARK [3][-]{subsubsection.7.1.2}{\376\377\000N\000o\000n\000-\000l\000i\000n\000e\000a\000r\000\040\000M\000o\000d\000e\000l}{subsection.7.1}% 25
\BOOKMARK [3][-]{subsubsection.7.1.3}{\376\377\000G\000R\000U\000\040\000M\000o\000d\000e\000l}{subsection.7.1}% 26
\BOOKMARK [2][-]{subsection.7.2}{\376\377\000D\000i\000f\000f\000u\000s\000i\000o\000n}{section.7}% 27
\BOOKMARK [1][-]{section.8}{\376\377\000P\000o\000l\000i\000c\000i\000e\000s\000\040\000f\000o\000r\000\040\000b\000a\000t\000t\000e\000r\000y\000\040\000o\000p\000t\000i\000m\000i\000z\000a\000t\000i\000o\000n}{}% 28
\BOOKMARK [2][-]{subsection.8.1}{\376\377\000B\000a\000s\000e\000l\000i\000n\000e\000s}{section.8}% 29
\BOOKMARK [2][-]{subsection.8.2}{\376\377\000P\000o\000l\000i\000c\000i\000e\000s\000\040\000u\000s\000i\000n\000g\000\040\000N\000R\000V\000\040\000p\000r\000e\000d\000i\000c\000t\000i\000o\000n\000s}{section.8}% 30
\BOOKMARK [1][-]{section.6}{\376\377\000R\000e\000s\000u\000l\000t\000s\000\040\000\046\000\040\000D\000i\000s\000c\000u\000s\000s\000i\000o\000n}{}% 21
\BOOKMARK [2][-]{subsection.6.1}{\376\377\000D\000a\000t\000a}{section.6}% 22
\BOOKMARK [3][-]{subsubsection.6.1.1}{\376\377\000L\000i\000n\000e\000a\000r\000\040\000M\000o\000d\000e\000l}{subsection.6.1}% 23
\BOOKMARK [3][-]{subsubsection.6.1.2}{\376\377\000N\000o\000n\000-\000l\000i\000n\000e\000a\000r\000\040\000M\000o\000d\000e\000l}{subsection.6.1}% 24
\BOOKMARK [3][-]{subsubsection.6.1.3}{\376\377\000G\000R\000U\000\040\000M\000o\000d\000e\000l}{subsection.6.1}% 25
\BOOKMARK [2][-]{subsection.6.2}{\376\377\000D\000i\000f\000f\000u\000s\000i\000o\000n}{section.6}% 26
\BOOKMARK [1][-]{section.7}{\376\377\000P\000o\000l\000i\000c\000i\000e\000s\000\040\000f\000o\000r\000\040\000b\000a\000t\000t\000e\000r\000y\000\040\000o\000p\000t\000i\000m\000i\000z\000a\000t\000i\000o\000n}{}% 27
\BOOKMARK [2][-]{subsection.7.1}{\376\377\000B\000a\000s\000e\000l\000i\000n\000e\000s}{section.7}% 28
\BOOKMARK [2][-]{subsection.7.2}{\376\377\000P\000o\000l\000i\000c\000i\000e\000s\000\040\000u\000s\000i\000n\000g\000\040\000N\000R\000V\000\040\000p\000r\000e\000d\000i\000c\000t\000i\000o\000n\000s}{section.7}% 29

Binary file not shown.

Binary file not shown.

View File

@@ -179,11 +179,7 @@
\include{sections/literature_study}
% In introduction
\section{TODO: Better title for this section}
This thesis can be divided into two main parts. The first part focuses on modeling the Net Regulation Volume (NRV) of the Belgian electricity market for the next day. This modeling is conditioned on multiple inputs that can be obtained from Elia (TODO: add citation to the open data of Elia). The second part of the thesis focuses on optimizing a simple policy using the NRV generations for the next day. The policy tries to maximize profit by charging and discharging a battery and thereby buying and selling electricity on the market. Multiple models are trained and tested to model the NRV and compared to each other based on their profit optimization.
\input{sections/nrv_prediction}
\input{sections/results}
\section{Policies for battery optimization}

View File

@@ -19,13 +19,12 @@
\contentsline {section}{\numberline {5}Literature Study}{18}{section.5}%
\contentsline {subsection}{\numberline {5.1}Electricity Price Forecasting}{18}{subsection.5.1}%
\contentsline {subsection}{\numberline {5.2}Policies for Battery Optimization}{19}{subsection.5.2}%
\contentsline {section}{\numberline {6}TODO: Better title for this section}{20}{section.6}%
\contentsline {section}{\numberline {7}Results \& Discussion}{20}{section.7}%
\contentsline {subsection}{\numberline {7.1}Data}{20}{subsection.7.1}%
\contentsline {subsubsection}{\numberline {7.1.1}Linear Model}{22}{subsubsection.7.1.1}%
\contentsline {subsubsection}{\numberline {7.1.2}Non-linear Model}{25}{subsubsection.7.1.2}%
\contentsline {subsubsection}{\numberline {7.1.3}GRU Model}{30}{subsubsection.7.1.3}%
\contentsline {subsection}{\numberline {7.2}Diffusion}{32}{subsection.7.2}%
\contentsline {section}{\numberline {8}Policies for battery optimization}{32}{section.8}%
\contentsline {subsection}{\numberline {8.1}Baselines}{32}{subsection.8.1}%
\contentsline {subsection}{\numberline {8.2}Policies using NRV predictions}{32}{subsection.8.2}%
\contentsline {section}{\numberline {6}Results \& Discussion}{20}{section.6}%
\contentsline {subsection}{\numberline {6.1}Data}{20}{subsection.6.1}%
\contentsline {subsubsection}{\numberline {6.1.1}Linear Model}{21}{subsubsection.6.1.1}%
\contentsline {subsubsection}{\numberline {6.1.2}Non-linear Model}{26}{subsubsection.6.1.2}%
\contentsline {subsubsection}{\numberline {6.1.3}GRU Model}{30}{subsubsection.6.1.3}%
\contentsline {subsection}{\numberline {6.2}Diffusion}{32}{subsection.6.2}%
\contentsline {section}{\numberline {7}Policies for battery optimization}{32}{section.7}%
\contentsline {subsection}{\numberline {7.1}Baselines}{32}{subsection.7.1}%
\contentsline {subsection}{\numberline {7.2}Policies using NRV predictions}{32}{subsection.7.2}%