80 Commits

Author SHA1 Message Date
67538857ab chore: itests: cleanup parts forgotten in #12407 (#12427) 2024-09-05 10:52:26 +02:00
1bc8a8b32c chore: remove (deprecated) deps on build/ proxy-constants
This is a large diff, yet should have exactly zero functional changes

Ideally as a result of this some parts of the depchain will become lighter,
with downstream reaping the same benefits as the team that initiated this split.

P.S. work was done while forming better intuition of current dependency graph
2024-07-22 17:36:12 +04:00
11dd4c9df7 chore: config: yet more lp2p removal from miner 2024-07-19 12:19:09 +04:00
7e37ee1b88 feat:ec:f3: add env var to disable F3 (#12176)
* F3-388: add env var to disable F3

Signed-off-by: Jakub Sztandera <oss@kubuxu.com>

* F3-388: check env variable in pubsub also

Signed-off-by: Jakub Sztandera <oss@kubuxu.com>

* F3-388: use DISABLE_F3=1 instead of _yes_ like in drand

Signed-off-by: Jakub Sztandera <oss@kubuxu.com>

* Use IsF3Enabled() and remove the runtime stopping

Signed-off-by: Jakub Sztandera <oss@kubuxu.com>

---------

Signed-off-by: Jakub Sztandera <oss@kubuxu.com>
Co-authored-by: Jakub Sztandera <oss@kubuxu.com>
2024-07-04 17:48:50 +02:00
7cdf9aa2cd feat: ec: Integrate Fast Finality for Filecoin (#12119)
Integrate F3 into Lotus

Signed-off-by: Jakub Sztandera <oss@kubuxu.com>
Co-authored-by: Jennifer Wang <jiayingw703@gmail.com>
Co-authored-by: Masih H. Derkani <m@derkani.org>
Co-authored-by: Steven Allen <steven@stebalien.com>
2024-06-28 17:10:58 +00:00
e3deda0b2b cleanup: miner: remove markets and deal-making from Lotus Miner (#12005)
* remove client CLI

* remove markets CLI from miner

* remove markets from all CLI

* remove client API

* update go mod

* remove EnableMarkets flag

* remove market subsystem

* remove dagstore

* remove index provider

* remove graphsync and data-transfer

* remove markets

* go mod tidy

* fix cbor gen deps

* remove deal making from config

* remove eol alert

* go mod tidy

* changes as per review

* make jen

* changes as per review

* merge master

* remove libp2p from config

* miner does not have libp2p conn in api test
2024-06-05 18:14:50 +04:00
0a51a0a219 feat!: build: separate miner and node version strings
Ref: https://github.com/filecoin-project/lotus/issues/12010
2024-05-30 10:02:43 +10:00
687ad3ae53 make db config in lotus-miner actually optional 2023-11-23 17:57:03 +01:00
f0a931edc9 fix: miner: Don't require db config when it's not used 2023-11-23 16:28:39 +01:00
9b4a3ba23d fix circleci and fiximports 2023-11-15 13:06:51 +01:00
c1edae62ad gen fix 2023-11-15 13:06:51 +01:00
f2ef006abd lotus-miner: add config for disabling winning post 2023-11-11 12:19:58 +01:00
ad4556e020 lotus miner config to entirely disable WindowPoSt 2023-11-09 18:11:10 +01:00
6b95bd24ba WIP: wdpost listener 2023-08-29 12:28:44 -04:00
a51e55390a address moar comments 2023-08-22 10:43:50 -04:00
652ee04ce2 working changes 2023-08-08 20:59:21 -04:00
864e8219ae WIP: sector index yugabyte impl 2023-08-05 16:15:23 -04:00
d17bfb14f8 feat: miner deps: harmonydb 2023-07-14 18:05:49 -05:00
Phi
7519f9fdf1 fix: Add lotus-miner legacy-markets alert
fix: Add lotus-miner legacy-markets alert
2023-05-15 13:13:06 +02:00
45667b7391 Upgrade to index-provider 0.10.0
Upgrade to the latest index-provider and as a result also upgrade
go-fil-markets.

Note that the index-provider go module is renamed and moved to `ipni`
GitHub org.
2023-01-10 13:08:04 +00:00
5f5cc794f0 make config not depend on ffi 2022-11-08 09:37:43 +00:00
d240b12196 feat: miner paramfetch: Don't fetch param files when not needed 2022-09-29 12:08:05 +00:00
ca72590e49 sealing: Use bitfields to manage sector numbers 2022-08-22 16:55:08 -04:00
60751f809b Change func name and nil pointer check based on comments 2022-08-17 10:47:05 -04:00
b7227d3a6b run make gen 2022-08-16 15:56:32 -04:00
fa4a479b97 Add uuid to mpool message sent to chain node from miner 2022-08-16 15:39:06 -04:00
71dacb5af8 sealing pipeline: Remove useless storage adapter code 2022-08-09 13:40:06 +02:00
59f3161fd6 wdpost: Config for disabling sector prechecks 2022-07-01 22:20:05 +02:00
db676acdf8 storage: Cleanup interfaces a bit 2022-06-17 13:52:19 +02:00
58416d0881 storage: Don't depend on specs-storage, move to storiface 2022-06-17 13:36:33 +02:00
05cdeb80c3 chore: remove redundant import prefixes 2022-06-15 12:06:22 +02:00
28099a3905 storage: Move storage/sealer/stores to storage/paths 2022-06-14 20:25:52 +02:00
a9600b8a6f storage: Move extern/sector-storage to storage/sealer 2022-06-14 20:03:38 +02:00
98a48a47f8 storage: Move extern/storage-sealing to storage/pipeline 2022-06-14 19:41:59 +02:00
717bda63b1 storage: Move control address logic to storage/ctladdr 2022-06-14 19:32:29 +02:00
dff1bf2868 storage: Move window-post logic into a separate package 2022-06-14 19:27:09 +02:00
30981d0fdd feat: refactor: actor bundling system (#8838)
1. Include the builtin-actors in the lotus source tree.
2. Embed the bundle on build instead of downloading at runtime.
3. Avoid reading the bundle whenever possible by including bundle
   metadata (the bundle CID, the actor CIDs, etc.).
4. Remove everything related to dependency injection.
    1. We're no longer downloading the bundle, so doing anything ahead
       of time doesn't really help.
    2. We register the manifests on init because, unfortunately, they're
       global.
    3. We explicitly load the current actors bundle in the genesis
       state-tree method.
    4. For testing, we just change the in-use bundle with a bit of a
       hack. It's not great, but using dependency injection doesn't make
       any sense either because, again, the manifest information is
       global.
    5. Remove the bundle.toml file. Bundles may be overridden by
       specifying an override path in the parameters file, or an
       environment variable.

fixes #8701
2022-06-13 10:15:00 -07:00
da8bda3248 fix typo 2022-05-12 09:47:27 +03:00
6bd2d89e30 use memory blockstore for miner manifest loading 2022-04-14 19:34:26 +03:00
507b835a9c need a blockstore for the manifest loader 2022-04-14 19:34:26 +03:00
395c772222 make the miner load the manifest so that it can correctly map actors 2022-04-14 19:34:26 +03:00
f369d99138 Fix DI of PubSub in markets by binding dependencies it needs
Bind drand and bootstrap peers config so that `PubSub` instantiated by
`ConfigCommon` has all the dependencies it needs when `PubSub` instance
is needed in markets. In ths case, the instance is needed by the index
provider engine to announce new indexing advertisements.
2022-04-06 20:04:39 +01:00
ebd34f1884 feat: storage: Parallel proving checks 2022-03-29 11:45:08 -04:00
54cb55a7ae feat: miner: API/CLI to compute window-post 2022-03-28 17:06:51 -04:00
92e4caa151 Merge remote-tracking branch 'origin/master' into feat/post-worker 2022-03-21 12:09:47 +01:00
7b81369c8c wdpost: Don't attempt to snark with skipped sectors 2022-03-18 19:45:25 +01:00
b9fe61f9da Merge branch 'master' into nonsense/refactor-nodetype 2022-03-07 11:51:28 +01:00
f1f878a000 unexport repo types; use a global var for every repo type 2022-03-03 15:37:23 +01:00
e3edab66e3 refactor RepoType 2022-03-03 15:37:23 +01:00
2ebc111b70 Use the same host and datatransfer as markets for index provider
Remove the bespoke instantiation of libp2p host and datatransfer manager
for index provider and reuse the existing instances used by markets.

The rationale for reuse is the following:
 1. Separation of host introduces a discovery problem, where without
    gossipsub the index provider endpoint will not be discoverable.
    Using the same host as markets would mean the chain can be used to
    discover addresses, putting less empassis on criticality of
    gossipsub considering its set-up cost and lack of message delivery
    guarantees.

 2. Only a single instance of graphsync/datatransfer can be instantiated
    per libp2p host; therefore, if the host is shared, so should
    datatransfer manager.

 3. it is not clear if the assumptions under which separation was
    decided still hold.
2022-02-16 13:46:44 +00:00