Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Entsoe error for Belgium: PT60M slots no longer available #16519

Closed
1 task done
djfanatix opened this issue Oct 6, 2024 · 27 comments
Closed
1 task done

Entsoe error for Belgium: PT60M slots no longer available #16519

djfanatix opened this issue Oct 6, 2024 · 27 comments
Labels
devices Specific device support question Rather clarification than issue

Comments

@djfanatix
Copy link
Contributor

djfanatix commented Oct 6, 2024 •
edited
Loading

Describe the bug

`site ] WARN 2024/10/06 08:26:28 planner: tariff not available: cannot create tariff type 'entsoe': no data for resolution: PT60M’

I got this error last night and the tariffs are blank in the planner.
I assume it is an entsoe api error, as my Home Assistant entsoe is also not working, but in the afternoon it was working.

Question: Entsoe updates the tariffs around 14.00 LT, does EVCC save this values in the database?
Is it possible to save the latest values and use them when the api is offline? (Instead of marking as unavailable)

Steps to reproduce

  1. Entsoe tariffs

...

Configuration details

/

Log details

[site ] WARN 2024/10/06 08:26:28 planner: tariff not available: cannot create tariff type 'entsoe': no data for resolution: PT60M

What type of operating system are you running?

Linux

Nightly build

  • I have verified that the issue is reproducible with the latest nightly build

Version

0.130.13
@bsmout
Copy link

bsmout commented Oct 6, 2024

I can confirm I have exactly the same issue today.

@andig andig closed this as completed Oct 6, 2024
@andig
Copy link
Member

andig commented Oct 6, 2024

Api issue, not evcc.

@djfanatix
Copy link
Contributor Author

Yes It is an API error, but why does EVCC not remember the values?

@andig
Copy link
Member

andig commented Oct 6, 2024

Because its usually not required.

@bolisaf
Copy link

bolisaf commented Oct 6, 2024

can we get more specific on the issue here so I can contact entsoe support?

@djfanatix djfanatix changed the title Entsoe error Entsoe error for Belgium Oct 7, 2024
@djfanatix
Copy link
Contributor Author

djfanatix commented Oct 7, 2024 •
edited
Loading

I like to reopen the issue, as entsoe has made changes for Belgian users.

See the issue here:

JaccoR/hass-entso-e#195

@andig
Copy link
Member

andig commented Oct 7, 2024 •
edited
Loading

Can you please share an API request (or config) and response for Belgium? Given evcc works in 60m slots right now the next question is how we should handle 15m slots: just take the first? use the average? or the maximum?

@andig andig reopened this Oct 7, 2024
@andig andig changed the title Entsoe error for Belgium Entsoe error for Belgium: PT60M slots no longer available Oct 7, 2024
@andig andig added bug Something isn't working devices Specific device support labels Oct 7, 2024
@djfanatix
Copy link
Contributor Author

I will check tonight.

But there are no 15M slots in Belgium, and I have not read anywhere that this will implemented in the near future.

So we could use the first one (or average) for the time being.

@rwegnerGermany
Copy link

I don't think it's limited to Belgium users. For Germany I also do have problems to get the prices, although with a different error message.
Please see https://github.com/evcc-io/evcc/discussions/16539#discussioncomment-10865062

To my understanding EVCC requires an update because of entsoe API changes within the last week.

As a workaround I just switched to Fraunhofer.

@wonko
Copy link

wonko commented Oct 7, 2024

This is an example request and response with some 15M data entries:

➜ curl https://web-api.tp.entsoe.eu/api\?securityToken\=<REDACTED>\&documentType\=A44\&out_Domain\=10YBE----------2\&in_Domain\=10YBE----------2\&periodStart\=202410060000\&periodEnd\=202410072300

<?xml version="1.0" encoding="utf-8"?>
  <Publication_MarketDocument xmlns="urn:iec62325.351:tc57wg16:451-3:publicationdocument:7:3">
    <mRID>64e2af3a87c2404cbea80edc067a1b6f</mRID>
    <revisionNumber>1</revisionNumber>
    <type>A44</type>
    <sender_MarketParticipant.mRID codingScheme="A01">10X1001A1001A450</sender_MarketParticipant.mRID>
    <sender_MarketParticipant.marketRole.type>A32</sender_MarketParticipant.marketRole.type>
    <receiver_MarketParticipant.mRID codingScheme="A01">10X1001A1001A450</receiver_MarketParticipant.mRID>
    <receiver_MarketParticipant.marketRole.type>A33</receiver_MarketParticipant.marketRole.type>
    <createdDateTime>2024-10-07T14:36:40Z</createdDateTime>
    <period.timeInterval>
      <start>2024-10-05T22:00Z</start>
      <end>2024-10-06T22:00Z</end>
    </period.timeInterval>
      <TimeSeries>
        <mRID>1</mRID>
        <auction.type>A01</auction.type>
        <businessType>A62</businessType>
        <in_Domain.mRID codingScheme="A01">10YBE----------2</in_Domain.mRID>
        <out_Domain.mRID codingScheme="A01">10YBE----------2</out_Domain.mRID>
        <contract_MarketAgreement.type>A01</contract_MarketAgreement.type>
        <currency_Unit.name>EUR</currency_Unit.name>
        <price_Measure_Unit.name>MWH</price_Measure_Unit.name>
        <curveType>A03</curveType>
          <Period>
            <timeInterval>
              <start>2024-10-05T22:00Z</start>
              <end>2024-10-06T22:00Z</end>
            </timeInterval>
            <resolution>PT15M</resolution>
              <Point>
                <position>1</position>
                 <price.amount>55.35</price.amount>
              </Point>
              <Point>
                <position>5</position>
                 <price.amount>44.22</price.amount>
              </Point>
              <Point>
                <position>9</position>
                 <price.amount>40.32</price.amount>
              </Point>
              <Point>
                <position>13</position>
                 <price.amount>31.86</price.amount>
              </Point>
              <Point>
                <position>17</position>
                 <price.amount>28.37</price.amount>
              </Point>
              <Point>
                <position>21</position>
                 <price.amount>28.71</price.amount>
              </Point>
              <Point>
                <position>25</position>
                 <price.amount>31.75</price.amount>
              </Point>
              <Point>
                <position>29</position>
                 <price.amount>35.47</price.amount>
              </Point>
              <Point>
                <position>33</position>
                 <price.amount>37.8</price.amount>
              </Point>
              <Point>
                <position>37</position>
                 <price.amount>33.31</price.amount>
              </Point>
              <Point>
                <position>41</position>
                 <price.amount>33.79</price.amount>
              </Point>
              <Point>
                <position>45</position>
                 <price.amount>16.68</price.amount>
              </Point>
              <Point>
                <position>49</position>
                 <price.amount>5.25</price.amount>
              </Point>
              <Point>
                <position>53</position>
                 <price.amount>-0.01</price.amount>
              </Point>
              <Point>
                <position>61</position>
                 <price.amount>0.2</price.amount>
              </Point>
              <Point>
                <position>65</position>
                 <price.amount>48.4</price.amount>
              </Point>
              <Point>
                <position>69</position>
                 <price.amount>50.01</price.amount>
              </Point>
              <Point>
                <position>73</position>
                 <price.amount>65.63</price.amount>
              </Point>
              <Point>
                <position>77</position>
                 <price.amount>77.18</price.amount>
              </Point>
              <Point>
                <position>81</position>
                 <price.amount>81.92</price.amount>
              </Point>
              <Point>
                <position>85</position>
                 <price.amount>64.36</price.amount>
              </Point>
              <Point>
                <position>89</position>
                 <price.amount>60.79</price.amount>
              </Point>
              <Point>
                <position>93</position>
                 <price.amount>52.33</price.amount>
              </Point>
          </Period>
          <Period>
            <timeInterval>
              <start>2024-10-06T22:00Z</start>
              <end>2024-10-07T22:00Z</end>
            </timeInterval>
            <resolution>PT15M</resolution>
              <Point>
                <position>1</position>
                 <price.amount>34.58</price.amount>
              </Point>
              <Point>
                <position>5</position>
                 <price.amount>35.34</price.amount>
              </Point>
              <Point>
                <position>9</position>
                 <price.amount>33.25</price.amount>
              </Point>
              <Point>
                <position>13</position>
                 <price.amount>29.48</price.amount>
              </Point>
              <Point>
                <position>17</position>
                 <price.amount>31.88</price.amount>
              </Point>
              <Point>
                <position>21</position>
                 <price.amount>41.35</price.amount>
              </Point>
              <Point>
                <position>25</position>
                 <price.amount>57.14</price.amount>
              </Point>
              <Point>
                <position>29</position>
                 <price.amount>91.84</price.amount>
              </Point>
              <Point>
                <position>33</position>
                 <price.amount>108.32</price.amount>
              </Point>
              <Point>
                <position>37</position>
                 <price.amount>91.8</price.amount>
              </Point>
              <Point>
                <position>41</position>
                 <price.amount>66.05</price.amount>
              </Point>
              <Point>
                <position>45</position>
                 <price.amount>60.21</price.amount>
              </Point>
              <Point>
                <position>49</position>
                 <price.amount>56.02</price.amount>
              </Point>
              <Point>
                <position>53</position>
                 <price.amount>43.29</price.amount>
              </Point>
              <Point>
                <position>57</position>
                 <price.amount>55</price.amount>
              </Point>
              <Point>
                <position>61</position>
                 <price.amount>57.6</price.amount>
              </Point>
              <Point>
                <position>65</position>
                 <price.amount>81.16</price.amount>
              </Point>
              <Point>
                <position>69</position>
                 <price.amount>104.54</price.amount>
              </Point>
              <Point>
                <position>73</position>
                 <price.amount>159.2</price.amount>
              </Point>
              <Point>
                <position>77</position>
                 <price.amount>149.41</price.amount>
              </Point>
              <Point>
                <position>81</position>
                 <price.amount>121.49</price.amount>
              </Point>
              <Point>
                <position>85</position>
                 <price.amount>90</price.amount>
              </Point>
              <Point>
                <position>89</position>
                 <price.amount>90.44</price.amount>
              </Point>
              <Point>
                <position>93</position>
                 <price.amount>77.18</price.amount>
              </Point>
          </Period>
          <Period>
            <timeInterval>
              <start>2024-10-07T22:00Z</start>
              <end>2024-10-08T22:00Z</end>
            </timeInterval>
            <resolution>PT60M</resolution>
              <Point>
                <position>1</position>
                 <price.amount>64.98</price.amount>
              </Point>
              <Point>
                <position>2</position>
                 <price.amount>57.86</price.amount>
              </Point>
              <Point>
                <position>3</position>
                 <price.amount>53.73</price.amount>
              </Point>
              <Point>
                <position>4</position>
                 <price.amount>47.52</price.amount>
              </Point>
              <Point>
                <position>5</position>
                 <price.amount>47.05</price.amount>
              </Point>
              <Point>
                <position>6</position>
                 <price.amount>56.89</price.amount>
              </Point>
              <Point>
                <position>7</position>
                 <price.amount>77.77</price.amount>
              </Point>
              <Point>
                <position>8</position>
                 <price.amount>88.24</price.amount>
              </Point>
              <Point>
                <position>9</position>
                 <price.amount>100</price.amount>
              </Point>
              <Point>
                <position>10</position>
                 <price.amount>84.92</price.amount>
              </Point>
              <Point>
                <position>11</position>
                 <price.amount>74.6</price.amount>
              </Point>
              <Point>
                <position>12</position>
                 <price.amount>68.82</price.amount>
              </Point>
              <Point>
                <position>13</position>
                 <price.amount>60.56</price.amount>
              </Point>
              <Point>
                <position>14</position>
                 <price.amount>63.86</price.amount>
              </Point>
              <Point>
                <position>15</position>
                 <price.amount>68.1</price.amount>
              </Point>
              <Point>
                <position>16</position>
                 <price.amount>68.37</price.amount>
              </Point>
              <Point>
                <position>17</position>
                 <price.amount>76.35</price.amount>
              </Point>
              <Point>
                <position>18</position>
                 <price.amount>54.04</price.amount>
              </Point>
              <Point>
                <position>19</position>
                 <price.amount>98.97</price.amount>
              </Point>
              <Point>
                <position>20</position>
                 <price.amount>115.47</price.amount>
              </Point>
              <Point>
                <position>21</position>
                 <price.amount>86.85</price.amount>
              </Point>
              <Point>
                <position>22</position>
                 <price.amount>69.59</price.amount>
              </Point>
              <Point>
                <position>23</position>
                 <price.amount>57.42</price.amount>
              </Point>
              <Point>
                <position>24</position>
                 <price.amount>50</price.amount>
              </Point>
          </Period>
      </TimeSeries>
  </Publication_MarketDocument>

Notice that the 15M time intervals only give an update every 4 blocks, which actually results in "hourly" updates. The API states that if a certain point isn't supplied with CurveType A3, the previous block value is repeated for the missing block.

See page 10 of https://transparency.entsoe.eu/content/static_content/download?path=/Static%20content/knowledge%20base/entso-e-transparency-xml-schema-use-1-0.pdf&loggedUserIsPrivileged=false

Hope this helps.

@djfanatix
Copy link
Contributor Author

Repost:

dear all, entsoe-py maintainer dropping in. Sorry to hear you had to build your own implementation due to pandas issue.
please note that the SDAC is currently on hourly basis and the 15 min data from Belgium is a bug. For my own datalake I have added a hardcoded exception that resamples the belgium prices.

for the future it is important to note that the SDAC will go to 15 min resolution somewhere Q1 or Q2 2025. This means that you will need the 15 min parser eventually since ALL countries will swap their day ahead prices to that resolution at the same time.

@Roeland54
Copy link
Contributor

So the belgian data is a bug. But the api response format from entso-e has changed with an update last friday. So a fix to parse the new format is still needed to get it back up and running for other countries.

A few differences with the old format:

  1. There are now multiple 'period' tags that contain points.
  2. If the price is the same as the previous point. This point won't be part of the xml. In the example you can see for 2024-10-08 that position 13 is missing. More information on the A3 curve type in this pdf page 14.

This is a valid response for Portugal:

<Publication_MarketDocument xmlns="urn:iec62325.351:tc57wg16:451-3:publicationdocument:7:3">
    <mRID>df5f07320f074c369d60428641fed537</mRID>
    <revisionNumber>1</revisionNumber>
    <type>A44</type>
    <sender_MarketParticipant.mRID codingScheme="A01">10X1001A1001A450</sender_MarketParticipant.mRID>
    <sender_MarketParticipant.marketRole.type>A32</sender_MarketParticipant.marketRole.type>
    <receiver_MarketParticipant.mRID codingScheme="A01">10X1001A1001A450</receiver_MarketParticipant.mRID>
    <receiver_MarketParticipant.marketRole.type>A33</receiver_MarketParticipant.marketRole.type>
    <createdDateTime>2024-10-07T16:18:12Z</createdDateTime>
    <period.timeInterval>
        <start>2024-10-06T22:00Z</start>
        <end>2024-10-07T22:00Z</end>
    </period.timeInterval>
    <TimeSeries>
        <mRID>1</mRID>
        <auction.type>A01</auction.type>
        <businessType>A62</businessType>
        <in_Domain.mRID codingScheme="A01">10YPT-REN------W</in_Domain.mRID>
        <out_Domain.mRID codingScheme="A01">10YPT-REN------W</out_Domain.mRID>
        <contract_MarketAgreement.type>A01</contract_MarketAgreement.type>
        <currency_Unit.name>EUR</currency_Unit.name>
        <price_Measure_Unit.name>MWH</price_Measure_Unit.name>
        <curveType>A03</curveType>
        <Period>
            <timeInterval>
                <start>2024-10-06T22:00Z</start>
                <end>2024-10-07T22:00Z</end>
            </timeInterval>
            <resolution>PT60M</resolution>
            <Point>
                <position>1</position>
                <price.amount>65.08</price.amount>
            </Point>
            <Point>
                <position>2</position>
                <price.amount>46.34</price.amount>
            </Point>
            <Point>
                <position>3</position>
                <price.amount>40</price.amount>
            </Point>
            <Point>
                <position>4</position>
                <price.amount>30.1</price.amount>
            </Point>
            <Point>
                <position>5</position>
                <price.amount>29.97</price.amount>
            </Point>
            <Point>
                <position>6</position>
                <price.amount>30.1</price.amount>
            </Point>
            <Point>
                <position>7</position>
                <price.amount>52.02</price.amount>
            </Point>
            <Point>
                <position>8</position>
                <price.amount>84.5</price.amount>
            </Point>
            <Point>
                <position>9</position>
                <price.amount>108.32</price.amount>
            </Point>
            <Point>
                <position>10</position>
                <price.amount>91.75</price.amount>
            </Point>
            <Point>
                <position>11</position>
                <price.amount>65.98</price.amount>
            </Point>
            <Point>
                <position>12</position>
                <price.amount>56.01</price.amount>
            </Point>
            <Point>
                <position>13</position>
                <price.amount>44.71</price.amount>
            </Point>
            <Point>
                <position>14</position>
                <price.amount>30.1</price.amount>
            </Point>
            <Point>
                <position>15</position>
                <price.amount>27.08</price.amount>
            </Point>
            <Point>
                <position>16</position>
                <price.amount>26.83</price.amount>
            </Point>
            <Point>
                <position>17</position>
                <price.amount>30.25</price.amount>
            </Point>
            <Point>
                <position>18</position>
                <price.amount>50.24</price.amount>
            </Point>
            <Point>
                <position>19</position>
                <price.amount>68</price.amount>
            </Point>
            <Point>
                <position>20</position>
                <price.amount>73.61</price.amount>
            </Point>
            <Point>
                <position>21</position>
                <price.amount>85.01</price.amount>
            </Point>
            <Point>
                <position>22</position>
                <price.amount>67.73</price.amount>
            </Point>
            <Point>
                <position>23</position>
                <price.amount>65.8</price.amount>
            </Point>
            <Point>
                <position>24</position>
                <price.amount>61.39</price.amount>
            </Point>
        </Period>
        <Period>
            <timeInterval>
                <start>2024-10-07T22:00Z</start>
                <end>2024-10-08T22:00Z</end>
            </timeInterval>
            <resolution>PT60M</resolution>
            <Point>
                <position>1</position>
                <price.amount>33.1</price.amount>
            </Point>
            <Point>
                <position>2</position>
                <price.amount>24.35</price.amount>
            </Point>
            <Point>
                <position>3</position>
                <price.amount>19.57</price.amount>
            </Point>
            <Point>
                <position>4</position>
                <price.amount>7</price.amount>
            </Point>
            <Point>
                <position>5</position>
                <price.amount>4.9</price.amount>
            </Point>
            <Point>
                <position>6</position>
                <price.amount>21.54</price.amount>
            </Point>
            <Point>
                <position>7</position>
                <price.amount>39.58</price.amount>
            </Point>
            <Point>
                <position>8</position>
                <price.amount>52.98</price.amount>
            </Point>
            <Point>
                <position>9</position>
                <price.amount>77.71</price.amount>
            </Point>
            <Point>
                <position>10</position>
                <price.amount>48.38</price.amount>
            </Point>
            <Point>
                <position>11</position>
                <price.amount>30.1</price.amount>
            </Point>
            <Point>
                <position>12</position>
                <price.amount>3.32</price.amount>
            </Point>
            <Point>
                <position>14</position>
                <price.amount>0.97</price.amount>
            </Point>
            <Point>
                <position>15</position>
                <price.amount>0.01</price.amount>
            </Point>
            <Point>
                <position>16</position>
                <price.amount>0</price.amount>
            </Point>
            <Point>
                <position>17</position>
                <price.amount>0.51</price.amount>
            </Point>
            <Point>
                <position>18</position>
                <price.amount>5</price.amount>
            </Point>
            <Point>
                <position>19</position>
                <price.amount>48.38</price.amount>
            </Point>
            <Point>
                <position>20</position>
                <price.amount>79.9</price.amount>
            </Point>
            <Point>
                <position>21</position>
                <price.amount>90</price.amount>
            </Point>
            <Point>
                <position>22</position>
                <price.amount>83.19</price.amount>
            </Point>
            <Point>
                <position>23</position>
                <price.amount>46.08</price.amount>
            </Point>
            <Point>
                <position>24</position>
                <price.amount>33.1</price.amount>
            </Point>
        </Period>
    </TimeSeries>
</Publication_MarketDocument>

@andig
Copy link
Member

andig commented Oct 7, 2024

But the api response format from entso-e has changed with an update last friday.

Since the linked document s from 2022- is this change documented anywhere?

@rwegnerGermany
Copy link

Maybe this helps: "All XML exports"....
https://github.com/JaccoR/hass-entso-e/issues/184#issuecomment-2393716780

@andig
Copy link
Member

andig commented Oct 7, 2024

Did a quick test. BE is broken as per Ensoe's docs. PT works fine afaikt. So... what's the issue?

@yvesilknievil yvesilknievil mentioned this issue Oct 7, 2024
Closed
@rwegnerGermany
Copy link

rwegnerGermany commented Oct 7, 2024 •
edited
Loading

For Germany zone, I just switched back to entsoe, restarted the docker container and checked the GUI.
It is showing todays prices for tomorrow und no valid prices for now:
grafik

This is the entsoe response in trace log. Is maybe the splitting into 2 periods new, as @Roeland54 mentioned?

<Publication_MarketDocument xmlns="urn:iec62325.351:tc57wg16:451-3:publicationdocument:7:3">
    <mRID>938364a9beb64bcb9a7a689d16385b01</mRID>
    <revisionNumber>1</revisionNumber>
    <type>A44</type>
    <sender_MarketParticipant.mRID codingScheme="A01">10X1001A1001A450</sender_MarketParticipant.mRID>
    <sender_MarketParticipant.marketRole.type>A32</sender_MarketParticipant.marketRole.type>
    <receiver_MarketParticipant.mRID codingScheme="A01">10X1001A1001A450</receiver_MarketParticipant.mRID>
    <receiver_MarketParticipant.marketRole.type>A33</receiver_MarketParticipant.marketRole.type>
    <createdDateTime>2024-10-07T17:33:34Z</createdDateTime>
    <period.timeInterval>
        <start>2024-10-06T22:00Z</start>
        <end>2024-10-07T22:00Z</end>
    </period.timeInterval>
    <TimeSeries>
        <mRID>1</mRID>
        <auction.type>A01</auction.type>
        <businessType>A62</businessType>
        <in_Domain.mRID codingScheme="A01">10Y1001A1001A82H</in_Domain.mRID>
        <out_Domain.mRID codingScheme="A01">10Y1001A1001A82H</out_Domain.mRID>
        <contract_MarketAgreement.type>A01</contract_MarketAgreement.type>
        <currency_Unit.name>EUR</currency_Unit.name>
        <price_Measure_Unit.name>MWH</price_Measure_Unit.name>
        <classificationSequence_AttributeInstanceComponent.position>1</classificationSequence_AttributeInstanceComponent.position>
        <curveType>A03</curveType>
        <Period>
            <timeInterval>
                <start>2024-10-06T22:00Z</start>
                <end>2024-10-07T22:00Z</end>
            </timeInterval>
            <resolution>PT60M</resolution>
            <Point>
                <position>1</position>
                <price.amount>34.58</price.amount>
            </Point>
            <Point>
                <position>2</position>
                <price.amount>35.34</price.amount>
            </Point>
            <Point>
                <position>3</position>
                <price.amount>33.25</price.amount>
            </Point>
            <Point>
                <position>4</position>
                <price.amount>30.15</price.amount>
            </Point>
            <Point>
                <position>5</position>
                <price.amount>36.09</price.amount>
            </Point>
            <Point>
                <position>6</position>
                <price.amount>46.73</price.amount>
            </Point>
            <Point>
                <position>7</position>
                <price.amount>67.59</price.amount>
            </Point>
            <Point>
                <position>8</position>
                <price.amount>100.92</price.amount>
            </Point>
            <Point>
                <position>9</position>
                <price.amount>108.32</price.amount>
            </Point>
            <Point>
                <position>10</position>
                <price.amount>91.86</price.amount>
            </Point>
            <Point>
                <position>11</position>
                <price.amount>66.09</price.amount>
            </Point>
            <Point>
                <position>12</position>
                <price.amount>60.22</price.amount>
            </Point>
            <Point>
                <position>13</position>
                <price.amount>54.11</price.amount>
            </Point>
            <Point>
                <position>14</position>
                <price.amount>43.29</price.amount>
            </Point>
            <Point>
                <position>15</position>
                <price.amount>55</price.amount>
            </Point>
            <Point>
                <position>16</position>
                <price.amount>67.01</price.amount>
            </Point>
            <Point>
                <position>17</position>
                <price.amount>97.9</price.amount>
            </Point>
            <Point>
                <position>18</position>
                <price.amount>120.71</price.amount>
            </Point>
            <Point>
                <position>19</position>
                <price.amount>237.65</price.amount>
            </Point>
            <Point>
                <position>20</position>
                <price.amount>229.53</price.amount>
            </Point>
            <Point>
                <position>21</position>
                <price.amount>121.98</price.amount>
            </Point>
            <Point>
                <position>22</position>
                <price.amount>99.93</price.amount>
            </Point>
            <Point>
                <position>23</position>
                <price.amount>91.91</price.amount>
            </Point>
            <Point>
                <position>24</position>
                <price.amount>79.12</price.amount>
            </Point>
        </Period>
        <Period>
            <timeInterval>
                <start>2024-10-07T22:00Z</start>
                <end>2024-10-08T22:00Z</end>
            </timeInterval>
            <resolution>PT60M</resolution>
            <Point>
                <position>1</position>
                <price.amount>72.33</price.amount>
            </Point>
            <Point>
                <position>2</position>
                <price.amount>67.07</price.amount>
            </Point>
            <Point>
                <position>3</position>
                <price.amount>63.99</price.amount>
            </Point>
            <Point>
                <position>4</position>
                <price.amount>59.67</price.amount>
            </Point>
            <Point>
                <position>5</position>
                <price.amount>59.69</price.amount>
            </Point>
            <Point>
                <position>6</position>
                <price.amount>67.43</price.amount>
            </Point>
            <Point>
                <position>7</position>
                <price.amount>85.97</price.amount>
            </Point>
            <Point>
                <position>8</position>
                <price.amount>110.37</price.amount>
            </Point>
            <Point>
                <position>9</position>
                <price.amount>106.24</price.amount>
            </Point>
            <Point>
                <position>10</position>
                <price.amount>85</price.amount>
            </Point>
            <Point>
                <position>11</position>
                <price.amount>80.33</price.amount>
            </Point>
            <Point>
                <position>12</position>
                <price.amount>80.5</price.amount>
            </Point>
            <Point>
                <position>13</position>
                <price.amount>76</price.amount>
            </Point>
            <Point>
                <position>14</position>
                <price.amount>82.53</price.amount>
            </Point>
            <Point>
                <position>15</position>
                <price.amount>88.39</price.amount>
            </Point>
            <Point>
                <position>16</position>
                <price.amount>90.08</price.amount>
            </Point>
            <Point>
                <position>17</position>
                <price.amount>101.19</price.amount>
            </Point>
            <Point>
                <position>18</position>
                <price.amount>126.34</price.amount>
            </Point>
            <Point>
                <position>19</position>
                <price.amount>156.77</price.amount>
            </Point>
            <Point>
                <position>20</position>
                <price.amount>168.2</price.amount>
            </Point>
            <Point>
                <position>21</position>
                <price.amount>114.41</price.amount>
            </Point>
            <Point>
                <position>22</position>
                <price.amount>94.9</price.amount>
            </Point>```

@Roeland54
Copy link
Contributor

Roeland54 commented Oct 7, 2024 •
edited
Loading

This is the only official info on the changes which is quite useless because it is lacking an explanation the xml format changes.

But the response is definitely changed.

@andig
Copy link
Member

andig commented Oct 8, 2024

BZN|DE scheint nur für heute Daten zu haben, auch im XML. Für mich ist kein Fehler erkennbar.

@andig andig closed this as completed Oct 8, 2024
@andig andig added question Rather clarification than issue and removed bug Something isn't working labels Oct 8, 2024
@axel-ppi
Copy link

axel-ppi commented Oct 8, 2024

Before the change to the ENTSO-E interface last week, the Day-Ahead prices [12.1.D] were delivered with curveType A01. These contained exactly one Period element per TimerSeries element, although the XML schema already allowed a list of Period elements per TimeSeries for curve type A01 as well.

With the change to curveType A03, the interface now supplies several Period elements per TimeSeries element. As this is not reflected in the entsoe model, only the last Period in a TimeSeries is read out by evcc.

As @Roeland54 already pointed out, curveType A03 only contains Points where price.amount has changed compared to the previous Point, whereas A01 contains all Points even in case the price.amount remains unchanged (see pdf chapter 4.3 page 14).

@andig
Copy link
Member

andig commented Oct 8, 2024

As this is not reflected in the entsoe model, only the last Period in a TimeSeries is read out by evcc.

I don‘t think so.

@rwegnerGermany
Copy link

At least this somehow makes sense with a 24h data period shown/assigned to the wrong (later) day.

I also would expect []TimeSeriesPeriod there.

And in the response it's weird that period.timeInterval start to end is only 24h, but 2 periods with 24h each are listed.

@axel-ppi
Copy link

axel-ppi commented Oct 8, 2024 •
edited
Loading

And in the response it's weird that period.timeInterval start to end is only 24h, but 2 periods with 24h each are listed.

As far as I remember, the interface was already behaving somewhat strangely in this respect before the change.
The difference, however, is that previously multiple TimeSeries with one Period each were delivered and now one TimeSeries with multiple Period elements.

@andig
Copy link
Member

andig commented Oct 9, 2024

For Germany, A3 curve today has 24 data points. Nothing missing.

At least this somehow makes sense with a 24h data period shown/assigned to the wrong (later) day.

I have not seen this error. Please open new issue.

@Roeland54
Copy link
Contributor

You need to validate this code against a entsoe response when the price for tomorrow is known. Before 13u00 the price of tomorrow will not be in the response.

@andig
Copy link
Member

andig commented Oct 9, 2024 

From                   To                     Price/Cost
2024-10-10 00:00:00    2024-10-10 01:00:00    0.020
2024-10-10 01:00:00    2024-10-10 02:00:00    0.004
2024-10-10 02:00:00    2024-10-10 03:00:00    0.002
2024-10-10 03:00:00    2024-10-10 04:00:00    0.001
2024-10-10 04:00:00    2024-10-10 05:00:00    0.002
2024-10-10 05:00:00    2024-10-10 06:00:00    0.017
2024-10-10 06:00:00    2024-10-10 07:00:00    0.040
2024-10-10 07:00:00    2024-10-10 08:00:00    0.053
2024-10-10 08:00:00    2024-10-10 09:00:00    0.048
2024-10-10 09:00:00    2024-10-10 10:00:00    0.035
2024-10-10 10:00:00    2024-10-10 11:00:00    0.030
2024-10-10 11:00:00    2024-10-10 12:00:00    0.026
2024-10-10 12:00:00    2024-10-10 13:00:00    0.020
2024-10-10 13:00:00    2024-10-10 14:00:00    0.006
2024-10-10 14:00:00    2024-10-10 15:00:00    0.003
2024-10-10 15:00:00    2024-10-10 16:00:00    0.009
2024-10-10 16:00:00    2024-10-10 17:00:00    0.030
2024-10-10 17:00:00    2024-10-10 18:00:00    0.040
2024-10-10 18:00:00    2024-10-10 19:00:00    0.061
2024-10-10 19:00:00    2024-10-10 20:00:00    0.049
2024-10-10 20:00:00    2024-10-10 21:00:00    0.047
2024-10-10 21:00:00    2024-10-10 22:00:00    0.041
2024-10-10 22:00:00    2024-10-10 23:00:00    0.040
2024-10-10 23:00:00    2024-10-11 00:00:00    0.040
2024-10-11 00:00:00    2024-10-11 01:00:00    0.044
2024-10-11 01:00:00    2024-10-11 02:00:00    0.055
2024-10-11 02:00:00    2024-10-11 03:00:00    0.069
2024-10-11 03:00:00    2024-10-11 04:00:00    0.091
2024-10-11 04:00:00    2024-10-11 05:00:00    0.109
2024-10-11 05:00:00    2024-10-11 06:00:00    0.092
2024-10-11 06:00:00    2024-10-11 07:00:00    0.069
2024-10-11 07:00:00    2024-10-11 08:00:00    0.040
2024-10-11 08:00:00    2024-10-11 09:00:00    0.040
2024-10-11 09:00:00    2024-10-11 10:00:00    0.040
2024-10-11 10:00:00    2024-10-11 11:00:00    0.040
2024-10-11 11:00:00    2024-10-11 12:00:00    0.041
2024-10-11 12:00:00    2024-10-11 13:00:00    0.055
2024-10-11 13:00:00    2024-10-11 14:00:00    0.072
2024-10-11 14:00:00    2024-10-11 15:00:00    0.100
2024-10-11 15:00:00    2024-10-11 16:00:00    0.129
2024-10-11 16:00:00    2024-10-11 17:00:00    0.180
2024-10-11 17:00:00    2024-10-11 18:00:00    0.173
2024-10-11 18:00:00    2024-10-11 19:00:00    0.120
2024-10-11 19:00:00    2024-10-11 20:00:00    0.109

Works just fine

@andig
Copy link
Member

andig commented Oct 9, 2024

Although... it seems to be missing 4 hours. I'll double-check.

@rwegnerGermany
Copy link

rwegnerGermany commented Oct 9, 2024 •
edited
Loading

Today morning I switched back to entsoe and the shown prices where correct for BZN|DE.

But now when prices for tomorrow where published, evcc again shows today prices for tomorrow:
grafik

33ct just isn't correct for tomorrow 20:00. That's todays price. It's supposed to be 31.9ct. Looks like again todays prices where applied to tomorrow.

So I restartet the container. Like shown above there is one timeseries with 2 periods. And for some reason additionally the PT15M resolution, which isn't allways included.
Today morning the response included 1 24h PT60M period only.

Response from 15:00 local time.
Energy_Prices_202410091400-202410101400.txt

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
devices Specific device support question Rather clarification than issue
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
8 participants
@wonko @andig @bolisaf @Roeland54 @axel-ppi @djfanatix @bsmout @rwegnerGermany