Commit graph

32 commits

Author SHA1 Message Date
illustris c3c9b51017
hadoop: 3.4.1 -> 3.4.2, use jdk21
- Update hadoop to 3.4.2
- Switch from jdk11 to jdk21
- Add support for lean variant builds
- Replace netstat with ss in tests
2025-10-06 22:03:11 +05:30
Wolfgang Walther 5a0711127c
treewide: run nixfmt 1.0.0 2025-07-24 13:55:40 +02:00
illustris 6709f7cea3
nixosTests.hadoop.hbase: fix race condition 2025-03-16 20:57:10 +05:30
illustris c62ec80d1f
hadoop, nixos/hadoop, nixosTests/hadoop: nixfmt 2024-12-14 00:31:48 +05:30
illustris b1e4a232f4
nixos/hadoop: fix failing hdfs test 2024-12-13 23:20:29 +05:30
illustris bdd10c641e
nixos/hadoop: fix failing yarn tests 2024-12-13 23:18:14 +05:30
Silvan Mosberger 4f0dadbf38 treewide: format all inactive Nix files
After final improvements to the official formatter implementation,
this commit now performs the first treewide reformat of Nix files using it.
This is part of the implementation of RFC 166.

Only "inactive" files are reformatted, meaning only files that
aren't being touched by any PR with activity in the past 2 months.
This is to avoid conflicts for PRs that might soon be merged.
Later we can do a full treewide reformat to get the rest,
which should not cause as many conflicts.

A CI check has already been running for some time to ensure that new and
already-formatted files are formatted, so the files being reformatted here
should also stay formatted.

This commit was automatically created and can be verified using

    nix-build a08b3a4d19.tar.gz \
      --argstr baseRev b32a094368
    result/bin/apply-formatting $NIXPKGS_PATH
2024-12-10 20:26:33 +01:00
illustris e761e8a979
hadoop: init 3.4, drop 3.2 2024-06-24 09:25:57 +05:30
K900 9843bbbeee treewide: replace <command> | systemd-cat with systemd-cat <command>
The former swallows exit codes, the latter doesn't.
2023-11-07 21:08:23 +03:00
illustris 1cd3c804bf
hadoop, nixos/hadoop: remove untarDir 2023-09-22 16:34:07 +05:30
Anderson Torres 9bdb3ee175 nixos/tests/hadoop/hdfs.nix: get rid of with lib 2023-05-12 22:29:27 -03:00
illustris 8f1c823ab0
nixos/hbase: add thrift and rest servers 2023-02-11 20:07:28 +05:30
illustris 9c16c997a6 nixos/hadoop.hbase: fix indentation 2022-08-07 21:21:45 +02:00
illustris 1285a586c5 nixos/hadoop: fix incorrect merging of yarnSiteInternal 2022-08-07 21:21:45 +02:00
illustris ac403b83fb nixos/hadoop: add HBase submodule 2022-08-07 21:21:45 +02:00
illustris e1017adb32 nixos/hadoop: add module options for commonly used service configs 2022-03-11 14:26:57 +05:30
illustris bef71d7c53 nixos/hadoop: use CGroups to enforce container limits by default 2022-03-11 14:18:44 +05:30
illustris 716b0dfaaf nixos/hadoop: add gateway role 2022-03-11 14:18:44 +05:30
illustris d39056d165 nixos/hadoop: fix tests for hadoop 2 and 3.2 2022-03-11 14:18:44 +05:30
illustris 8aeb60f034 nixos/hadoop: use FairScheduler by default 2022-03-11 14:18:44 +05:30
illustris 799dc66cf1 hadoop: add passthrough tests 2022-03-11 14:18:44 +05:30
illustris 0f97c9ae82 nixos/hadoop: disable openFirewall by default 2022-03-11 14:18:44 +05:30
Artturin 54ece050b8 nixos/qemu-vm: default memorySize 384 -> 1024
the default hasn't been changed since 2009
this can improve our test performances

nixos/tests: remove explicit memorySize <1024

1024MiB is now the default
2021-11-21 17:27:58 +02:00
illustris c3d147f507 nixos/hadoop: replace "enabled" options with "enable" options
The module has been using "enabled" in place of enable since init ( 0c10b2baa6 )
2021-11-03 22:44:25 +05:30
illustris 9ca4363191 nixos/hadoop: add HTTPFS 2021-11-03 22:44:25 +05:30
illustris 39c007ce9c nixos/hadoop: Add HA capabilities
- Add HDFS journalnode and ZKFC services
- Test failover of HDFS and YARN master services in full hadoop test
- Check if a minimal HDFS cluster works in the minimal HDFS test
2021-11-03 22:44:24 +05:30
illustris 6688c52254 nixos/hadoop: add better test
The existing tests for HDFS and YARN only check if the services come up and expose their web interfaces.
The new combined hadoop test will also test whether the services and roles work together as intended.
It spin up an HDFS+YARN cluster and submit a demo YARN application that uses the hadoop cluster for
storageand yarn cluster for compute.
2021-10-25 16:30:19 +09:00
Scott Worley f99b6369b1 nixos/tests/hadoop: Use curl --fail 2020-10-25 11:01:31 +01:00
Christian Kampka 5cb7b2cf60
nixosTests.hadoop.yarn: Port tests to python 2019-12-17 09:37:06 +01:00
Christian Kampka 563eea492b
nixosTests.hadoop.hdfs: Port tests to python 2019-12-17 09:37:02 +01:00
volth 2e979e8ceb [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
Allan Espinosa 0c10b2baa6 nixos/hadoop: add hadoop module (hdfs, yarn) 2018-06-29 23:14:02 -04:00