kasownik/fetch
Kasownik 363ab2b3f6 fix pekaobiznes scraper 2024-01-22 12:02:11 +01:00
..
protos fetch: add smsgw/2FA support 2019-10-03 13:32:28 +02:00
README.md fetch: add smsgw/2FA support 2019-10-03 13:32:28 +02:00
banking-ib.py guwno 2020-10-12 17:26:51 +02:00
banking-ibcloud.py support historic banking data retrieval 2021-03-07 22:57:04 +01:00
banking-pekaobiznes.py fix pekaobiznes scraper 2024-01-22 12:02:11 +01:00
config.ini.dist fetch: add config.ini.dist for pekaobiznes 2022-01-01 15:02:37 +01:00
config.py.dist fetch: add smsgw/2FA support 2019-10-03 13:32:28 +02:00
fetch.sh fetch.sh: default to ibcloud 2019-11-08 20:56:18 +01:00
models.py backing-pekaobiznes: rework CLI tool 2022-01-01 14:58:58 +01:00
pip-requirements.txt fetch: add smsgw/2FA support 2019-10-03 13:32:28 +02:00
smsgw_pb2.py fetch: add smsgw/2FA support 2019-10-03 13:32:28 +02:00
smsgw_pb2_grpc.py fetch: add smsgw/2FA support 2019-10-03 13:32:28 +02:00
triggers.sql fetch: Add raw_transfer_copy() procedure SQL dump 2018-03-15 14:26:05 +01:00

README.md

Fetcher

This is a separate process used for fetching of bank account data from IdeaBank.

Raw transfer data is fetched into raw_transfers table (using credentails separate from web interface worker) and are forwarded into transfers with trigger and stored procedure (check it out in triggers.sql)

This process has its own config.py (example available in config.py.dist).

raw_transfers table schema is presented when executing:

python banking-ib.py --print-schema

gRPC proto files (smsgw_pb2*.py) can be rebuilt using:

python -m grpc_tools.protoc -Iprotos --python_out=. --grpc_python_out=. protos/smsgw.proto

TODO

  • Cleanup logging