1
0
Fork 0
mirror of https://github.com/postmannen/ctrl.git synced 2024-12-14 12:37:31 +00:00
Commit graph

69 commits

Author SHA1 Message Date
postmannen
df07b926e2 moved all the procfunc definitions in the processes startup as separate functions defined after theyr respective request method where they belong 2024-12-06 11:03:53 +01:00
postmannen
3a31ced938 Squashed commit of the following:
implemented reading and embedding the content of a local file with {{CTRL_FILE}}

fixed error with not found filename in copy test, remove debug logs

seedfile: removed deletion, and changed file permissions to 600

created flags for profiling

renamed startup.subscriber to startup.startProcess

created a separate method for helloPublisher

removed processKind, og removed not needed file check in copy request

removed sams from channels

removed publisher channel on subject, and messages to publish are now directly published from the newMessagesCh

removed no longer needed compression and serialization flags.

all messaging are using zstd for compression, and cbor for serializing

added functions for handling cbor serializing and zstd compression, and swapped out json marshaling of jetstream message data with cbor and zstd

added flag for max jetstream messages to keep on broker per subject
2024-12-03 16:17:33 +01:00
postmannen
cdf660aa07 add NODES.all as jetstream subject, and updated doc
added handling of consumed jetstream messages, and fixed a read error with readFolder which sometimes read empty content

newMessagesCh now takes single sam instead of []sams

added jetstream publish channel
2024-11-27 08:34:49 +01:00
postmannen
6c615591a6 Squashed commit of the following:
commit 2a5cb441ff8c3f3f4404c49188c16afdb701cd42
Author: postmannen <postmannen@gmail.com>
Date:   Tue Nov 19 06:46:58 2024 +0100

    updated doc

commit a97d2dd4fd162a45dcf8f80d833a31bdc7e0b817
Author: postmannen <postmannen@gmail.com>
Date:   Tue Nov 19 06:25:57 2024 +0100

    renamed the various naming for channels where new messages are put to newMessagesCh

commit 3c840eb718358bb55d9e1c58692517e4bbbb5f4d
Author: postmannen <postmannen@gmail.com>
Date:   Tue Nov 19 05:08:55 2024 +0100

    Restructured configuration, and added a StartProcesses struct for the flags that are for starting processes
2024-11-19 20:28:26 +01:00
postmannen
b1a5406598 Squashed commit of the following:
commit ec6ea8158d5051010c25ef848a7b7b91fa40efef
Author: postmannen <postmannen@gmail.com>
Date:   Tue Nov 19 03:48:03 2024 +0100

    Removed remaining use of REQ in naming

commit b80bb06a47cf564a88d684c1d1d4fe2e408c3c0f
Author: postmannen <postmannen@gmail.com>
Date:   Mon Nov 18 23:15:32 2024 +0100

    removed REQ in more variable names, including methods

commit af7f6fef3e0093312d2ca12740f7b27840797800
Author: postmannen <postmannen@gmail.com>
Date:   Mon Nov 18 22:54:40 2024 +0100

    renamed all the method type variables

commit e657ecb37f
Author: postmannen <postmannen@gmail.com>
Date:   Mon Nov 18 22:32:13 2024 +0100

    renamed methods constant values and removed REQ
2024-11-19 03:48:42 +01:00
postmannen
2fb43591ce updated readme
removed example for no longer existing relay messages
cleaned up comments
Removed some remaings after REQToFileNACK
Implemented env variables for all flags, and removed config flag. Also added use of .env file.
removed configuration as input argument from all the loggers
replaced logging of new messages in read folder with a logDebug so we don't send those messages to the error kernel
2024-03-27 12:48:17 +01:00
postmannen
c098c623f1 cleaned up no longer used code 2024-03-08 22:55:21 +01:00
postmannen
69995f76ca updated package info
updated references
removed tui client
removed ringbuffer persist store
removed ringbuffer
enabled audit logging
moved audit logging to message readers
disabled goreleaser
update readme, cbor, zstd
removed request type ping and pong
update readme
testing with cmd.WaitDelay for clicommand
fixed readme
removed ringbuffer flag
default serialization set to cbor, default compression set to zstd, fixed race,
removed event type ack and nack, also removed from subject. Fixed file stat error for copy log file
removed remaining elements of the event type
removed comments
renamed toRingbufferCh to samToSendCh
renamed directSAMSCh ro samSendLocalCh
removed handler interface
agpl3 license
added license-change.md
2024-02-07 22:54:50 +01:00
postmannen
4c7ec43da2 removed not needed error check 2023-06-14 06:47:13 +02:00
postmannen
f23fa053f6 added check for correctness for path for copy messages 2023-06-09 09:09:37 +02:00
postmannen
b2215181e7 added source patch to copydstdone 2023-06-09 05:18:24 +02:00
postmannen
ea9738950d initial implementation where toFile also writes to sockets 2023-06-06 12:23:26 +02:00
postmannen
ce1eba687a added file info content to copyDstDone messages 2023-06-02 12:27:18 +02:00
postmannen
8c8061dc15 renamed logConsoleOnlyIfDebug to logDebug 2023-01-12 12:03:10 +01:00
postmannen
076abdef71 changed from log package to slog 2023-01-12 12:01:01 +01:00
postmannen
807455119c Added x/slog for stderr logging 2023-01-11 08:38:15 +01:00
postmannen
541f243067 added group permissions for files/directories created 2023-01-10 06:50:28 +01:00
postmannen
84284eeee1 removed debug logging 2022-12-31 06:14:06 +01:00
postmannen
a77d1ad562 cleaned up os.Remove log 2022-12-31 06:02:26 +01:00
postmannen
98137b1df1 not creating a sub process before we check if it exists 2022-12-26 10:12:45 +01:00
postmannen
3f5b58ffab fixed timeouts for copy messages 2022-12-21 09:27:52 +01:00
postmannen
29a382838c fixed typo in debug message 2022-12-21 08:16:45 +01:00
postmannen
8d017c072d discard copy messages when more procs are started for the same copySrc request 2022-12-19 07:21:53 +01:00
postmannen
2c1ed934dd allways delete tmpFolder when copyDstSubProcFunc is done. 2022-12-14 05:48:44 +01:00
postmannen
33df0df948 added acktimeout and replies to the copysub messages 2022-12-02 10:04:20 +01:00
postmannen
70408d24e9 write reply messages for copysub procs back to src node 2022-11-23 09:18:02 +01:00
postmannen
852cd86c61 removed line feeds 2022-10-14 10:22:51 +02:00
postmannen
757792c787 added creation of dst folder for copySrc 2022-10-14 10:12:50 +02:00
postmannen
f5e5e4337e added feature to copy file from remote to local 2022-09-06 10:43:27 +02:00
postmannen
c6013a2968 fixed race+allocation in copySrcSubProcFunc 2022-06-22 05:03:11 +02:00
postmannen
8ec6372565 fixed returns and error msgs for copy handlers 2022-06-21 07:45:36 +02:00
postmannen
988bd04d7f limited allocactions for copyReady 2022-06-18 07:35:59 +02:00
postmannen
0d4bfd4471 fixed logging with copy handlers 2022-06-18 00:43:42 +02:00
postmannen
b1bcefb949 terminating subproc publishers if inactive for given amount of time 2022-06-18 00:03:25 +02:00
postmannen
b8a2d3d5e7 removed copyFile<from/to> and relay request types 2022-06-16 23:32:44 +02:00
postmannen
a03ff25da4 fixed using the MaxTotalCopyTime from message 2022-06-16 23:00:27 +02:00
postmannen
800bd16d33 on dst chunk files are read in correct order 2022-06-16 12:18:21 +02:00
postmannen
f3f5e64c45 added seprata timwe for MaxAllowedCopy time which can be specified in the original message 2022-06-16 07:12:03 +02:00
postmannen
1bdee3872b ending both src and dst sub procs when done copy 2022-06-16 06:42:34 +02:00
postmannen
fab3fa38dd simplified chunk write with Write(b[:n]) 2022-06-16 06:15:18 +02:00
postmannen
0b4356b548 removed debug 2022-06-15 21:08:54 +02:00
postmannen
2d36e0195b fixed wrong file size when writing at dst 2022-06-15 20:55:20 +02:00
postmannen
e010a1633a removing tmp files when done 2022-06-15 20:12:48 +02:00
postmannen
97ef587a0e resend on error, retries, preserve file permissions 2022-06-15 14:47:20 +02:00
postmannen
2745374da3 initial implementation of hash check for copy messages 2022-06-15 10:38:53 +02:00
postmannen
69e0bd3696 copy, src defines and sets the split chunk size 2022-06-15 09:48:32 +02:00
postmannen
036894a3fe writing tmp and final destinaton files 2022-06-15 07:51:58 +02:00
postmannen
23c22210a5 comments 2022-06-15 05:31:46 +02:00
postmannen
df0c2ddc90 receiving copy data at dst 2022-06-15 05:06:44 +02:00
postmannen
8d39c3c746 initial sending of chunks seems to work 2022-06-14 15:05:38 +02:00