41 Commits

Include renames

Author	SHA1	Message	Date
Bobby NoelteandGitHub	886c93c92b	fix: default server settings prevent env var config (#1234) ... Change configuration source priorities to: - cli - environment vars - dotenv settings - config file settings - init settings By this the environment vars supersede any configuration var provided by the configuration file or by the initialisation with pydantic. The test_config.py::test_computed_path was fixed to to not use the defaul env var overwrite defined by conftest.py. This seemed to indicate non working env vars, but in fact was a test setupt fault. Besides this fix there are other fixes and changes added: * fix: exclude computed fields when merging settings Pydantic may overwrite settings by values given for computed fields and use these values instead of re-computing the field. Avoid computed fields in merging settings. * chore: improve Windows compatability of development setup Improve scripts to better run also on Windows. When doing path checks keep compatibility also to Windows pathes. A lot of changes to avoid the famous Windows CRLF handling and keep line endings to LF. * chore: add development hint for Windows Windows developers should set core.autocrlf to false. * chore: update version Signed-off-by: b0661 <b0661n0e17e@gmail.com>	2026-08-16 13:56:25 +02:00
Bobby NoelteandGitHub	269d2162a9	fix: server crash on prediction update failure (#1222) ... Catch exceptions from prediction update and log as error message. Keep executing the energy management run. Signed-off-by: Bobby Noelte <b0661n0e17e@gmail.com>	2026-08-08 11:37:50 +02:00
Bobby NoelteandGitHub	1905682113	chore: adapt pdf visualization (#1205) ... Change PDF visualization to be created on demand and per optimization algorithm. The PDF for the GENETIC0 optimization is provided by the /visualization_results.pdf endpoint. There is no change in the interface. By this the optimization algorithm is offloaded from the PDF generation which spares some time. To cope with several users may call the /visualization_results.pdf endpoint at the same time the PDF is generated on the fly without any intermediate file taking the stored GENETIC0 solution as an input. SVG picture generation is removed as this would again create intermediate files. Chart pictures can easily be taken from the PDF. To allow on demand creation of the optimization results visualization the optimisation solution stored is extended by several new attributes. To keep the deprecated /optimize endpoint compatible the optimization solution is stripped to the legacy content before returned. Due to the extension of the solution the optimization tests were adapted to cover the extended content. The optimization tests are adapted to test the generated visualization report by the pypdf reader. Pypdf is added to the development dependencies. Besides the adaptation several fixes and improvements are added: * feat: extend /v1/prediction/series endpoint by resampling and filling Add parameters for resampling and filling. Add the processing parameter to control wether raw data or resampled data shall be returned. * feat: extend /v1/measurement/series endpoint by resampling and filling Add parameters for resampling and filling: Add the processing parameter to control wether raw data or resampled data shall be returned. * feat: standardize and improve API error response Use FASTApi exception handlers to provide a standardized API exception handling. All exceptions are logged. Exception traces are only returned if the new logging configuration parameter logging.api_logging_level is set to "DEBUG" or "TRACE". Avoids unwanted leackage of server internals on exceptions. * fix: align to intervall when resampling Ensure resampling is aligned to interval also when the buckets are shifted due to the align_to_intervall parameter is set. * chore: make dropna mandatory and default to True * chore: refactor key_to_xxx data management methods Make key_to_series the central method for data resampling and fill. Add a new key_to_raw_series to retrieve the data as it is stored (without resampling and filling). Users of key_to_series were mostly moved to key_to_raw_series as this resembles the former interface. Especially in predictions and tests this was done. * chore: create test data sub-directory for each optimization algorithm To prevent cluttering the test data directory and ease test data management for optimization algorithms each algorithm got it's own sub-directory. The current test data was moved to these sub-directories. * chore: update version Signed-off-by: Bobby Noelte <b0661n0e17e@gmail.com>	2026-08-01 12:45:19 +02:00
Bobby NoelteandGitHub	8344974c16	chore: adapt deprecated endpoints to 15-minutes predictions (#1195) ... Ensure the deprecated endpoints get /strompreis, post /gesamtlast, get /gesamtlast_simple, get /pvforecast to work on 1-hour intervalls even if the prediction provides 15-minutes intervall data. This keeps the interface compliant to the legacy functionality. Besides this adaptations several other improvements and fixes are included in this PR. * feat: extend data management method key_to array by resample_method One can now define the resample method on how to aggregate the values in an interval for resampling. Three methods are provided: - "first": Use the first value in each interval. - "mean": Compute the arithmetic mean of all samples in each interval. - "interval_mean": Compute the time-weighted mean assuming each value remains valid until the next timestamp (piecewise-constant signal). * feat: extend the get /v1/prediction/dataframe endpoint with resampling parameters Make all parameters for resampling available at the endpoint. * feat: extend the get /v1/prediction/list endpoint with resampling parameters Make all parameters for resampling available at the endpoint. * feat: add new delete /v1/prediction/range endpoint The endpoint allows to delete prediction values for a given time span. * fix: adapt for PVForecastAkkudoktor server side cache handling /api.akkudoktor/forecast does it's own caching on requests. Call it with slightly randomized request values to avoid getting cached values in the case we need fresh data. The requests are anyway rate limited to one request per hour on our side. * chore: add core.types This module centralizes reusable type definitions shared across multiple packages. Defining common types here avoids duplication of complex type annotations (such as Literal aliases), ensures consistent typing across the code base, and helps prevent circular import dependencies between modules. * chore: extend cache testing * chore: add system test for deprecated /strompreis endpoint * chore: add unit test module for server endpoints Add a new test module to do unit tests on server endpoints. First test added for deprecated get /strompreis endpoint. Signed-off-by: Bobby Noelte <b0661n0e17e@gmail.com>	2026-07-30 19:54:05 +02:00
Bobby NoelteandGitHub	52fe489d4e	feat: add dvhubonline feed-in tariff provider (#1193) ... Fetches GET /api/prices?start&end&zone (15-min slots, EUR/MWh) and stores the raw market price as feed_in_tariff_wh (EUR/Wh) — no import charges/VAT. Slots beyond the day-ahead horizon are left to the consumer's forward-fill (FeedInTariffImport behaviour). 5 unit tests + opt-in live smoke (EOS_DVHUB_ONLINE_LIVE=1, passing). Signed-off-by: Christin <info@bikinibottom.capital> Signed-off-by: Bobby Noelte <b0661n0e17e@gmail.com>	2026-07-29 22:21:17 +02:00
Bobby NoelteandGitHub	e23bb7b497	chore: prepare for update of genetic algorithm (#1190) ... Andreas will update the genetic algorithm for 15-minutes optimization intervals. Copy the current GENETIC optimization algorithm to GENETIC0 to enable to keep the algorithm with the current functionality. Also copy resources like the load interpolator to the GENETIC0 algorithm to keep them despite possible later changes to the interpolator. Make the deprecated legacy /optimize endpoint use the GENETIC0 optimization algorithm to in-fact behave the same way even if there will later be changes to the GENETIC algorithm by Andreas. Add a new REST endpoint to provide the unprocessed optimisation results of the GENETIC and GENETIC0 algorithm in case one wants to use them as done with the deprecated /optimize endpoint. Adapt the optimization configuration to have distinct configurations for the GENETIC and the GENETIC0 algorithm. Create a copy of the current tests for the GENETIC algorithm to be used for the GENETIC0 algorithm. This avoids the tests for the GENETIC0 algorithm to be influenced by later changes by Andreas. Signed-off-by: Bobby Noelte <b0661n0e17e@gmail.com>	2026-07-29 12:56:08 +02:00
Bobby NoelteandGitHub	7e5aa2f218	feat: add Tibber feed-in tariff provider (#1189) ... The `FeedInTariffTibber` provider requests `priceInfo` and `priceInfoRange` with `resolution: QUARTER_HOURLY` and preserves the native 15-minute timestamps. It uses Tibber's `energy` spot-price component without the `tax` part or EOS electricity-price charges. The end-customer `total` component is deliberately ignored. The provider deliberately rejects hourly API responses instead of silently repeating them. It reuses `elecprice.tibber.access_token` and `elecprice.tibber.home_id`, so no duplicate credentials are needed. Signed-off-by: Andreas Schmitz <akkudoktor.net> Signed-off-by: Bobby Noelte <b0661n0e17e@gmail.com>	2026-07-24 15:52:26 +02:00
Bobby NoelteandGitHub	4c8a8e40f5	feat: add Akkudoktor feed-in provider (#1187) ... The `FeedInTariffAkkudoktor` provider uses raw day-ahead market prices from `https://api.akkudoktor.net/prices` as `feed_in_tariff_wh`. It does not add electricity import charges or VAT. Published prices are extended to the configured prediction horizon with the same seasonal ETS or median fallback used by the Akkudoktor electricity-price provider. The Akkudoktor endpoint currently forwards hourly market prices from aWATTar. With a 15-minute optimization interval, EOS holds each hourly price constant for its four quarter-hour slots. This keeps the slot grid consistent but does not create genuine quarter-hour market prices. Signed-off-by: Andreas Schmitz <akkudoktor.net> Signed-off-by: Bobby Noelte <b0661n0e17e@gmail.com>	2026-07-23 22:37:38 +02:00
Bobby NoelteandGitHub	ed61918fe0	feat: add EnergyCharts feed-in tariff provider (#1165) ... The `FeedInTariffEnergyCharts` provider uses the raw Energy-Charts day-ahead market price as the feed-in tariff. It stores prices in `feed_in_tariff_wh` without adding electricity import charges or VAT. The data is loaded from the Energy-Charts `/price` endpoint for the configured bidding zone. The native Energy-Charts resolution, including quarter-hour data, is retained. Energy-Charts usually supplies prices only for the published day-ahead period. If that data does not cover the complete configured prediction horizon, the provider extends it as follows: - With more than 800 hours of history, an ETS (Holt-Winters exponential smoothing) forecast with weekly seasonality is used. - With more than 168 hours of history, an ETS forecast with daily seasonality is used. - With less history, the median of the available values is used as a constant fallback. The seasonal periods are adjusted to the source resolution. For example, quarter-hour data uses four values per hour. Values already supplied by Energy-Charts are kept unchanged; only missing future slots after the last published price are forecast. Consequently, a 15-minute optimization uses four forecast values per hour without converting them to hourly averages. Signed-off-by: Andreas Schmitz <akkudoktor.net> Signed-off-by: Bobby Noelte <b0661n0e17e@gmail.com>	2026-07-23 15:48:29 +02:00
Bobby NoelteandGitHub	6093d8d348	chore: improve error msg on home assistant add-on port config (#1186) ... When running as a Home Assistant add-on the ports shall not be changed as this would break config.yaml that is used by Home Assistant. Prevent the change and return an error message. Extra fixes: * fix: EOS configuration initialisation by cli under EOSdash. Signed-off-by: Bobby Noelte <b0661n0e17e@gmail.com>	2026-07-23 15:11:18 +02:00
Bobby NoelteandGitHub	641873d867	fix: akkudoktor api requests (#1181) ... The akkudoktor api for PV forecast seems to be changed and does not support to concatenate several planes into one request anymore. Make a request for every plane and add up the power results. Do not use the new 15 minutes slots as the returned data does not include the hourly values for windspeed and temperature as does the hourly slots. Signed-off-by: Bobby Noelte <b0661n0e17e@gmail.com>	2026-07-20 21:46:01 +02:00
Bobby NoelteandGitHub	2ed04d5573	fix: db compaction run (#1156) ... These fixes were taken from https://github.com/arneman/EOS/tree/refactor/economic-objective. 1. Fix compaction job registration bug in eos.py: - compact_eos_database was registered with save_eos_database function - Now correctly calls compact_eos_database() - Root cause: compaction/vacuum never ran, allowing records to grow unbounded 2. Optimize db_iterate_records() from O(n) to O(log n): - Previous: linear scan from index 0 for every key_to_array() call - Now: uses bisect_left on _db_sorted_timestamps to skip to start position - Critical for large datasets: 9400 measurement records → 94s/call overhead → 5 calls/optimization 3. Reduce compaction_interval_sec default from 604800s (7 days) to 3600s (1 hour): - With 7-day interval: 65000 records accumulate before first cleanup - Bridge pushes ~1 record/9s (grid_export_emr) - Hourly compaction + 2h data window → stable ~950 records Signed-off-by: Bobby Noelte <b0661n0e17e@gmail.com>	2026-07-20 12:59:08 +02:00
Bobby NoelteandGitHub	a0febef6a7	fix: coroutine never awaited (#1155) ... Ensure await is called on key_to_array() before conversion to list by to_list(). Signed-off-by: Bobby Noelte <b0661n0e17e@gmail.com>	2026-07-17 19:35:38 +02:00
Bobby NoelteandGitHub	4381948f13	fix: price interpolation (#1154) ... Use forward fill to interpolate time series data that represents prices: - elecprice_marketprice_wh - feed_in_tariff_wh Signed-off-by: Bobby Noelte <b0661n0e17e@gmail.com>	2026-07-17 18:05:29 +02:00
3 people	75548990e1	feat: add cloud PV forecast providers: pvnode.com, forecast-solar and solcast (#1150) ... This PR adds three native PV power forecast providers, giving operators more cloud forecast sources to choose from via pvforecast.provider, alongside the existing PVForecastAkkudoktor, PVForecastVrm and PVForecastImport: PVForecastPVNode — native 15-minute forecasts from the pvnode.com V2 API. Saved-site mode (GET /v2/forecast/{site_id}) where the operator enters their API key + site id, or inline mode (POST /v2/forecast/inline) using the configured planes. PVForecastForecastSolar — the free Forecast.Solar API (no key required for the public endpoint). Multi-plane systems issue one request per plane and the instantaneous powers are summed per timestamp. PVForecastSolcast — the Solcast rooftop-site API (API key + resource id). Implementation notes All three populate the existing pvforecast_ac_power (and mirror pvforecast_dc_power) prediction keys, so they slot into the optimizer unchanged. Timezone handling: pvnode and Forecast.Solar return site-local wall-clock timestamps with an IANA timezone field, which are resolved to absolute instants before resampling; Solcast returns UTC period_end and is normalised to the period start. Each provider follows the existing provider pattern (provider_id(), _request_forecast() with @cache_in_file, _update_data()), is registered in pvforecast.py and prediction.py, and is upstream-neutral. Validation 27 unit tests (timezone resolution, null/zero handling, kW→W and period-start conversion, azimuth conversion, multi-plane summation, request URL/auth, HTTP-error handling). ruff check (F/D/S/bandit) and ruff format clean. Each provider was additionally validated against its live API with a real plant, confirming the response shapes (pvnode: 288 native 15-min slots; Forecast.Solar: instantaneous watts; Solcast: kW estimates with period_end/PT30M). Documentation Provider descriptions and configuration examples added to docs/akkudoktoreos/prediction.md. CHANGELOG.md entry under Unreleased. Regenerated docs/_generated/configpvforecast.md and configexample.md. Notes for reviewers Forecast.Solar's free endpoint is rate-limited (12 req/hour) and Solcast's free tier limits daily calls; both providers rely on the standard 1-hour cache_in_file TTL to stay within budget. Authors: The code is created by Christin. Only minor adaptions by Bobby. Signed-off-by: Christin <info@bikinibottom.capital> Signed-off-by: Bobby Noelte <b0661n0e17e@gmail.com> Co-authored-by: Christin <info@bikinibottom.capital>	2026-07-17 16:51:00 +02:00
Bobby NoelteandGitHub	0306e7e4ed	fix: prediction import with pydantic-typed bodies (#1152) ... Respect pydantic model in serializing json data for import. Signed-off-by: Bobby Noelte <b0661n0e17e@gmail.com>	2026-07-16 17:15:10 +02:00
Bobby NoelteandGitHub	eb9e966de9	fix: move data management to async (#1015) ... FAstAPI is an async framework. Data may be imported and exported, load and save, set and get asynchronously. Prevent interleaving data operations to corrupt the data. In the previous design sync and async data access was intermixed leading to data corruption. The basic data classes DataSequence and DataContainer and the derived classes like Provider and Measurement now are async. Data access is protected by several async locks. To support the async design of the data classes the database interface became async. The energy management is also adapted to the new async design. Optimization is still off-loaded to another thread, but the prepration for the optimization and the post optimization actions now follow the async design. Adapter operations are now also protected by async locks. Tests were adapted to the async design and new tests were created. Besides this major fix several other improvements and fixes are included in this PR. * fix: key_to_dict/list/array only regard data records with key value set. Before the exclusion of no value data records was only done if the dropna flag was set. * fix: test for visual result pdf generation Due to updates in the library the generated charts text was a little bit different. Adapt the test to create the comaprison pdf in the test data durectory and update the reference pdf. * chore: Remove MutableMapping from DataSequence and DataContainer. Mutable Mapping does not fit to the now async design. * chore: Add NoDB database backend This backend implements the full database backend interface but performs no actual persistence. It is intended for configurations where database persistence is disabled (`provider=None`). * chore: Improve measurement data import testing with real world scenarios. Added two new endpoints to support testing. * chore: Add mermaid to supported documentation tools * chore: Add documentation about async design * chore: Add documentation about generic data handling Covers the basics of measurement and prediction time series data handling. * chore: Add empty lines around markdown lists. * chore: sync pre-commit config to updated package versions Signed-off-by: Bobby Noelte <b0661n0e17e@gmail.com>	2026-07-15 16:38:53 +02:00
3 people	6f28022ed0	fix: optimization fail after restart (#1007) ... Fix documentation for the loadforecast_power_w key. Fix documentation to explain the usage of import file/ JSON string to primarily initialise prediction data. Fix code scanning alert no. 6: URL redirection from remote source Enable to automatically save the configuration to the configuration file by default, which is a widespread user expectation. Make the genetic parameters non optional for better pydantic compliance. Update: - bump pytest to 9.0.3 - bump pillow to 12.2.0 - bump platformdirs to 4.9.6 - bump typespyyaml to 6.0.12.20260408 - bump tzfpy to 1.2.0 - bump pydantic to 2.13.0 - bump types-requests to 2.33.0.20260408 Signed-off-by: Bobby Noelte <b0661n0e17e@gmail.com> Co-authored-by: Normann <github@koldrack.com>	2026-04-15 08:48:56 +02:00
Bobby NoelteandGitHub	2da724ecf4	chore: improve openmeteo test (#974) ... Make openmeteo test robust against timing issues. Also update: - types-docutils==0.22.3.20260322 - pytest-cov==7.1.0 - ruff-pre-commit v0.15.7 - uvlock Signed-off-by: Bobby Noelte <b0661n0e17e@gmail.com>	2026-03-26 12:32:30 +01:00
Bobby NoelteandGitHub	5fb5234e7d	fix: device id in solution follows configuration (#964) ... Make device id in solution follow actual configuration. Adapt version update to new CI bump workflow design. Signed-off-by: Bobby Noelte <b0661n0e17e@gmail.com>	2026-03-18 08:41:28 +01:00
Bobby NoelteandGitHub	9f74c4a515	chore: Prepare Release v0.3.0 (#959) ... This pull request prepares release **v0.3.0**. Akkudoktor-EOS can now be run as Home Assistant add-on and standalone. As Home Assistant add-on EOS uses ingress to fully integrate the EOSdash dashboard in Home Assistant. Adapters for Home Assistant and NodeRed integration are added. These adapters provide a simplified interface to these HEMS besides the standard REST interface. The prediction and measurement data can now be backed by a database. The database allows to keep historic prediction data and measurement data for long time without keeping it in memory. The database supports backend selection, compression, incremental data load, automatic data saving to storage, automatic vacuum and compaction. Two database backends are integrated and can be configured, LMDB and SQLight3. New prediction providers allow to access OpenMeteo weather data and to define fixed electricity prices for configurable time windows. An anoying bug in the genetic algorithm that created unfeasable battery charge and discharge amounts is now hopefully fixed. In addition, bugs were fixed and new features were added. See CHANGELOG for full details. Signed-off-by: Bobby Noelte <b0661n0e17e@gmail.com>	2026-03-17 18:40:21 +01:00
Bobby NoelteandGitHub	963a495f7e	fix: openmeteo test (#957) ... Make test more robust against time race conditions. Signed-off-by: Bobby Noelte <b0661n0e17e@gmail.com>	2026-03-17 13:59:17 +01:00
3 people	779395cef5	fix: genetic optimizer charge rates, SoC accuracy, and minor bugfixes (#949) ... * record battery SOC at the start of the interval for accurate display * map battery charge rates to GeneticOptimizationParameters and update related logic Instead of using the EV charge rates, the battery now has its own charge rate defined in the GeneticOptimizationParameters to better separate those entities. * separate raw gene values from SOC-clamped op factors The genetic_*_factor columns in the OptimizationSolution dataframe now always carry the raw gene values (optimizer intent), while the battery1_*_op_mode / battery1_*_op_factor columns and FRBCInstruction operation_mode_factor reflect SOC-clamped effective values that can actually be executed given the battery's state of charge at each hour. Adds GeneticSolution._soc_clamped_operation_factors(): - AC charge factor: proportionally scaled down when battery headroom (max_soc - current_soc) is less than what the commanded factor would store in one hour; zeroed when battery is full. - DC charge factor: zeroed when battery is at or above max SOC. - Discharge: blocked when SOC is at or below min SOC. Both optimization_solution() and energy_management_plan() pass the clamped values to _battery_operation_from_solution(), so the plan instructions the HEMS receives reflect physically achievable targets. * ensure max AC charge power is only used if defined * update fixtures for PV suffix + SOC-clamp algorithm changes * handle None case for home appliance start hour in simulation if the hour is zero, the the home appliance wont start * update handling of invalid charge indices in autocharge hours Seems to be a bug, since all invalid indexes needs to be invalidated (also the first one) * remove double code in simulation preparation and improve comments * update version Signed-off-by: Bobby Noelte <b0661n0e17e@gmail.com> Co-authored-by: Christopher Nadler <christopher.nadler@gmail.com>	2026-03-17 12:41:15 +01:00
Bobby NoelteandGitHub	71e5abce88	fix: energy charts bidding zone in request (#948) ... Ensure that the bidding zone in the request is correctly set to a string value (not an enum). This seems to be also an issue with python version < 3.11. Add safeguards to only use python >= 3.11. Still keep a regression test for the enum conversion to string. Signed-off-by: Bobby Noelte <b0661n0e17e@gmail.com>	2026-03-15 13:32:05 +01:00
Bobby NoelteandGitHub	b67148c47f	feat: make home assistant add-on run optimization by default (#940) ... When running as Home Assistant add-on the only viable usage is running with cyclic optimization. Make this the default to als propvide a better experience for first time users. The optimization will start with demo data, which also helps to configure Akkudoktor-EOS to the personal usage. The disabling of the automatic energy management is now an explicit mode "DISABLED". Signed-off-by: Bobby Noelte <b0661n0e17e@gmail.com>	2026-03-13 15:48:43 +01:00
Bobby NoelteandGitHub	8a9aec6d57	feat: add openmeteo weather provider (#939) ... Add OpenMeteo to the selectable weather prediction providers. Also add tests and documentation. Signed-off-by: Bobby Noelte <b0661n0e17e@gmail.com>	2026-03-13 12:23:21 +01:00
Bobby NoelteandGitHub	cf477d91a3	feat: add fixed electricity prediction with time window support (#930) ... Add a fixed electricity prediction that supports prices per time window. The time windows may flexible be defined by day or date. The prediction documentation is updated to also cover the ElecPriceFixed provider. The feature includes several changes that are not directly related to the electricity price prediction implementation but are necessary to keep EOS running properly and to test and document the changes. * feat: add value time windows Add time windows with an associated float value. * feat: harden eos measurements endpoints error detection and reporting Cover more errors that may be raised during endpoint access. Report the errors including trace information to ease debugging. * feat: extend server configuration to cover all arguments Make the argument controlled options also available in server configuration. * fix: eos config configuration by cli arguments Move the command line argument handling to config eos so that it is excuted whenever eos config is rebuild or reset. * chore: extend measurement endpoint system test * chore: refactor time windows Move time windows to configabc as they are only used in configurations. Also move all tests to test_configabc. * chore: provide config update errors in eosdash with summarized error text If there is an update error provide the error text as a summary. On click provide the full error text. * chore: force eosdash ip address and port in makefile dev run Ensure eosdash ip address and port are correctly set for development runs. Signed-off-by: Bobby Noelte <b0661n0e17e@gmail.com>	2026-03-11 17:18:45 +01:00
Bobby NoelteandGitHub	1832364d60	fix: pydantic datetime dataframe timezone conversion (#927) ... Signed-off-by: Bobby Noelte <b0661n0e17e@gmail.com>	2026-03-08 21:04:22 +01:00
Bobby NoelteandGitHub	997e7646e9	fix: prevent exception when load prediction data is missing (#925) ... Validate solution prediction data before processing. If required prediction data is missing, the prediction is skipped instead of raising an exception. Introduce a new configuration file saving policy to improve loading robustness: - Exclude computed fields - Exclude fields set to their default values - Exclude fields with value None - Use field aliases - Recursively remove empty dictionaries and lists - Ensure general.version is always present and correctly set When loading older configuration files, computed fields are now stripped before migration. This further improves backward compatibility and loading robustness. Signed-off-by: Bobby Noelte <b0661n0e17e@gmail.com>	2026-03-07 14:46:30 +01:00
Bobby NoelteandGitHub	aa09678242	chore: guard against visualization errors in genetic optimization (#920) ... Make genetic optimization run ignore errors in solution visualization. Signed-off-by: Bobby Noelte <b0661n0e17e@gmail.com>	2026-03-01 11:52:08 +01:00
Bobby NoelteandGitHub	bbc4fe308a	chore: bump numpydantic to 1.8.0. (#918) ... Skip Shape doc in RST compliance test. Signed-off-by: Bobby Noelte <b0661n0e17e@gmail.com>	2026-02-28 16:56:50 +01:00
Bobby NoelteandGitHub	237af5289f	fix: eosdash startup (#915) ... Adapt uvicorn log level to allowed levels. Ensure that EOSdash is started after EOS configuration is available. Signed-off-by: Bobby Noelte <b0661n0e17e@gmail.com>	2026-02-28 11:31:51 +01:00
Bobby NoelteandGitHub	32e690becf	fix: EOS run asynchronous tasks (#904) ... Startup retention manager for asynchronous tasks. Handle gracefully exceptions in these tasks or the configuration for them. Remove tasks.py as repeated tasks are now handled by the retention manager. When running on GitHub, only the version date file is checked. The development tag is merely a label, so any date set during development suffices. The test_doc is also skipped on GitHub actions.	2026-02-24 23:17:11 +01:00
Bobby NoelteandGitHub	378377b1ce	fix: test break docs and on data compaction (2) (#902) ... Ensure that the snapping sequence generated in the test fixture is within the boundaries expected by the test. Ensure we read the _version_date.py info as UTC datetime and do no localtime conversion. Prevent and guard test_version.py to modify the version date file. Signed-off-by: Bobby Noelte <b0661n0e17e@gmail.com>	2026-02-24 18:56:11 +01:00
Bobby NoelteandGitHub	90e2e8af7e	fix: test break on docs version and data compaction (#900) ... Upgrade to: - pandas==3.01 - fastapi[standard-no-fastapi-cloud-cli]==0.132.0 - fastapi_cli==0.0.23 - MonsterUI==1.0.44 - uvicorn==0.41.0 Close database in database fixture on teardown. Fix file exclusion in hash and version date generation. Update version information in documentation. Signed-off-by: Bobby Noelte <b0661n0e17e@gmail.com>	2026-02-24 07:37:22 +01:00
Bobby NoelteandGitHub	d446274129	fix: Adapt versioning scheme to Home Assistant and switch to uv (#896) ... Home Assistant expects versioning always increases numbers. Add a date component to the development version to comply with this expectation. The scheme is now 0.0.0.dev<date><hash>. Use uv for creating and managing the virtual environment for developement. This enourmously speeds up dependency updates. For this change dependency requirements are now solely handled in pyproject.toml. requirements.tx and requirements-dev.txt are deleted. Signed-off-by: Bobby Noelte <b0661n0e17e@gmail.com>	2026-02-23 20:59:03 +01:00
Bobby NoelteandGitHub	6498c7dc32	Add database support for measurements and historic prediction data. (#848) ... The database supports backend selection, compression, incremental data load, automatic data saving to storage, automatic vaccum and compaction. Make SQLite3 and LMDB database backends available. Update tests for new interface conventions regarding data sequences, data containers, data providers. This includes the measurements provider and the prediction providers. Add database documentation. The fix includes several bug fixes that are not directly related to the database implementation but are necessary to keep EOS running properly and to test and document the changes. * fix: config eos test setup Make the config_eos fixture generate a new instance of the config_eos singleton. Use correct env names to setup data folder path. * fix: startup with no config Make cache and measurements complain about missing data path configuration but do not bail out. * fix: soc data preparation and usage for genetic optimization. Search for soc measurments 48 hours around the optimization start time. Only clamp soc to maximum in battery device simulation. * fix: dashboard bailout on zero value solution display Do not use zero values to calculate the chart values adjustment for display. * fix: openapi generation script Make the script also replace data_folder_path and data_output_path to hide real (test) environment pathes. * feat: add make repeated task function make_repeated_task allows to wrap a function to be repeated cyclically. * chore: removed index based data sequence access Index based data sequence access does not make sense as the sequence can be backed by the database. The sequence is now purely time series data. * chore: refactor eos startup to avoid module import startup Avoid module import initialisation expecially of the EOS configuration. Config mutation, singleton initialization, logging setup, argparse parsing, background task definitions depending on config and environment-dependent behavior is now done at function startup. * chore: introduce retention manager A single long-running background task that owns the scheduling of all periodic server-maintenance jobs (cache cleanup, DB autosave, …) * chore: canonicalize timezone name for UTC Timezone names that are semantically identical to UTC are canonicalized to UTC. * chore: extend config file migration for default value handling Extend the config file migration handling values None or nonexisting values that will invoke a default value generation in the new config file. Also adapt test to handle this situation. * chore: extend datetime util test cases * chore: make version test check for untracked files Check for files that are not tracked by git. Version calculation will be wrong if these files will not be commited. * chore: bump pandas to 3.0.0 Pandas 3.0 now performs inference on the appropriate resolution (a.k.a. unit) for the output dtype which may become datetime64[us] (before it was ns). Also numeric dtype detection is now more strict which needs a different detection for numerics. * chore: bump pydantic-settings to 2.12.0 pydantic-settings 2.12.0 under pytest creates a different behaviour. The tests were adapted and a workaround was introduced. Also ConfigEOS was adapted to allow for fine grain initialization control to be able to switch off certain settings such as file settings during test. * chore: remove sci learn kit from dependencies The sci learn kit is not strictly necessary as long as we have scipy. * chore: add documentation mode guarding for sphinx autosummary Sphinx autosummary excecutes functions. Prevent exceptions in case of pure doc mode. * chore: adapt docker-build CI workflow to stricter GitHub handling Signed-off-by: Bobby Noelte <b0661n0e17e@gmail.com>	2026-02-22 14:12:42 +01:00
Bobby NoelteandGitHub	df92e6157f	fix: logging long lines from EOSdash (#843) ... Truncate long lines on logging from EOSdash. Rate limit log messages from EOSdash to prevent overload. Log messages read and dropped to avoid EOSdash is blocked on standard or error output. Signed-off-by: Bobby Noelte <b0661n0e17e@gmail.com>	2026-01-08 10:08:59 +01:00
Bobby Noelte	7c98383e1f	chore: improve Home Assistant adapter ... Add documentation for home assistant adapter. Make adapter correctly set the measurement keys for PV production. Add adapter configuration for grid import and export measurements. Signed-off-by: Bobby Noelte <b0661n0e17e@gmail.com>	2026-01-03 15:43:54 +01:00
Bobby NoelteandGitHub	e6dcd377d6	fix: EOS loguru logging of EOSdash stdout logs (#827) ... When patching loguru logging records do not replace structured loguru fields. Signed-off-by: Bobby Noelte <b0661n0e17e@gmail.com>	2026-01-01 15:52:48 +01:00
Bobby NoelteandGitHub	58d70e417b	feat: add Home Assistant and NodeRED adapters (#764) ... Adapters for Home Assistant and NodeRED integration are added. Akkudoktor-EOS can now be run as Home Assistant add-on and standalone. As Home Assistant add-on EOS uses ingress to fully integrate the EOSdash dashboard in Home Assistant. The fix includes several bug fixes that are not directly related to the adapter implementation but are necessary to keep EOS running properly and to test and document the changes. * fix: development version scheme The development versioning scheme is adaptet to fit to docker and home assistant expectations. The new scheme is x.y.z and x.y.z.dev<hash>. Hash is only digits as expected by home assistant. Development version is appended by .dev as expected by docker. * fix: use mean value in interval on resampling for array When downsampling data use the mean value of all values within the new sampling interval. * fix: default battery ev soc and appliance wh Make the genetic simulation return default values for the battery SoC, electric vehicle SoC and appliance load if these assets are not used. * fix: import json string Strip outer quotes from JSON strings on import to be compliant to json.loads() expectation. * fix: default interval definition for import data Default interval must be defined in lowercase human definition to be accepted by pendulum. * fix: clearoutside schema change * feat: add adapters for integrations Adapters for Home Assistant and NodeRED integration are added. Akkudoktor-EOS can now be run as Home Assistant add-on and standalone. As Home Assistant add-on EOS uses ingress to fully integrate the EOSdash dashboard in Home Assistant. * feat: allow eos to be started with root permissions and drop priviledges Home assistant starts all add-ons with root permissions. Eos now drops root permissions if an applicable user is defined by paramter --run_as_user. The docker image defines the user eos to be used. * feat: make eos supervise and monitor EOSdash Eos now not only starts EOSdash but also monitors EOSdash during runtime and restarts EOSdash on fault. EOSdash logging is captured by EOS and forwarded to the EOS log to provide better visibility. * feat: add duration to string conversion Make to_duration to also return the duration as string on request. * chore: Use info logging to report missing optimization parameters In parameter preparation for automatic optimization an error was logged for missing paramters. Log is now down using the info level. * chore: make EOSdash use the EOS data directory for file import/ export EOSdash use the EOS data directory for file import/ export by default. This allows to use the configuration import/ export function also within docker images. * chore: improve EOSdash config tab display Improve display of JSON code and add more forms for config value update. * chore: make docker image file system layout similar to home assistant Only use /data directory for persistent data. This is handled as a docker volume. The /data volume is mapped to ~/.local/share/net.akkudoktor.eos if using docker compose. * chore: add home assistant add-on development environment Add VSCode devcontainer and task definition for home assistant add-on development. * chore: improve documentation	2025-12-30 22:08:21 +01:00