jesopo
c898bc4be1
utils.http.request_many() shouldn't decode data for Response
2019-11-26 13:54:17 +00:00
jesopo
2d21dfa229
utils.http.Response.data should always be bytes - add .decode and .soup
2019-11-26 13:42:01 +00:00
jesopo
ed775ddbe3
remove parser from utils.http.Request, add Request.soup()
2019-11-26 11:35:56 +00:00
jesopo
93aea08818
utils.datetime.datetime_utcnow() -> utils.datetime.utcnow()
2019-11-25 18:18:09 +00:00
jesopo
6a6e789ec9
add cookies and .json() to utils.http.Response objects
2019-11-25 18:17:30 +00:00
jesopo
ab8bc65cc9
change utils.http.Request to be a dataclass
2019-11-25 13:42:10 +00:00
jesopo
5730d6fe59
refactor commands (mostly stdout/stderr) and split typing/reply out
...
closes #208
2019-11-22 16:23:30 +00:00
jesopo
2dfc55fb9f
refactor permissions and allow hostmasks to be assigned to accounts
2019-11-21 15:49:08 +00:00
jesopo
9f8c5acf52
add a way to execute commands through bitbotd (use for master-password)
2019-11-21 10:39:26 +00:00
jesopo
4d30263315
give bitbot a unique User-Agent
...
closes #206
2019-11-20 14:42:34 +00:00
jesopo
11c3104d02
move things like IRCBot.VERSION to before imports (for utils.http)
2019-11-20 14:41:14 +00:00
jesopo
bd176240d6
consecutive HASH_STOP chars at start shouldn't count as a stop
2019-11-19 14:45:47 +00:00
jesopo
554f21a84c
HASH_STOP should still be respected if last character
2019-11-19 14:43:24 +00:00
jesopo
bc6b1dda47
chance src/Cache.py from time.monotonic() to time.time()
2019-11-19 11:41:50 +00:00
jesopo
65023dc84b
move "+5m" syntax parsing out to utils.parse
2019-11-18 15:57:23 +00:00
jesopo
fe25c6bc26
switch some utils.irc functions to use f-strings
2019-11-18 14:16:30 +00:00
jesopo
d89a3125ab
truncate nickname hash operations to 64bit
2019-11-18 14:09:47 +00:00
jesopo
a8b1bd95f7
implement weechat-style djb2 colour hashing
2019-11-18 13:51:55 +00:00
jesopo
a7e21abfad
import missing comma, 'Events'->'Event'
2019-11-18 12:10:20 +00:00
jesopo
06161b326c
remove unused imports in src/utils/__init__.py
2019-11-18 12:09:18 +00:00
jesopo
9c4902dcfe
"EventsResultsError"->"EventResultsError", move errors to utils.error
2019-11-18 12:06:59 +00:00
jesopo
5d55086847
move utils.consts.BITBOT_MAGIC to utils.decorators
2019-11-15 14:09:35 +00:00
jesopo
5d01db8514
move all datetime-related code from utils/__init__ to utils.datetime
2019-11-15 13:59:09 +00:00
jesopo
5e8cf06a45
dont expose has_magic/get_magic in utils/__init__.py, ref directly
2019-11-15 13:41:03 +00:00
jesopo
bfcf40edd7
split some stuff out of utils/__init__.py
2019-11-15 13:39:24 +00:00
jesopo
2cb55306c3
show first-words datestamp on !words output
2019-11-15 12:13:16 +00:00
jesopo
c9cb8c8805
set info log rolling backup count to 1 (0 means "keep all backups")
2019-11-14 13:35:23 +00:00
jesopo
a1e9aabb84
add typehinting for foreground/background
2019-11-13 10:47:58 +00:00
jesopo
5d2dd9178f
only set color_finished=True when is_background, otherwise next char sets it
2019-11-13 10:43:15 +00:00
jesopo
8a8bd8a77e
colorize nicks on JOIN formatting
2019-11-11 12:49:45 +00:00
jesopo
b7bfd414be
hash_colorize code should first be looked up in HASH_COLORS
2019-11-11 12:48:37 +00:00
jesopo
727fb3427d
.lower() strings when hash-colorizing them
2019-11-11 12:40:36 +00:00
jesopo
ac30f8d4cc
don't use hash() for hashed colorising as it's not stable through restarts
2019-11-11 12:13:46 +00:00
jesopo
2ad8623eb3
add utils.irc.hash_colorize() to color a string by the string's hash
2019-11-11 12:06:16 +00:00
jesopo
98183fe4b9
add IRCArgs.append func
2019-11-08 17:41:18 +00:00
jesopo
5fcf18313e
silently eat Control socket .send() failures
2019-11-08 13:38:07 +00:00
jesopo
09fe1c5a70
don't stop parsing colors at comma
2019-11-04 13:33:10 +00:00
jesopo
bcdffacab5
add on_pause() and on_resume() for module - use in rest_api.py
2019-11-04 10:52:41 +00:00
jesopo
2b001e1ec6
' ' -> " "
2019-10-31 13:06:26 +00:00
Valentin Lorentz
fbf8cd1a16
Fix type errors detected by 'mypy --ignore-missing-imports src'.
2019-10-30 22:26:59 +01:00
jesopo
9958c9169d
fix _line() related type hinting issues in IRCServer.py
2019-10-30 13:46:29 +00:00
jesopo
3634b72622
add utils.date_human() - use it in badges.py
2019-10-30 10:25:07 +00:00
jesopo
4d85c3d1e0
utils.parse doesn't need to import utils
2019-10-29 18:03:03 +00:00
jesopo
080bcef3a0
'from src.utils import' -> 'from . import'
2019-10-29 18:02:50 +00:00
jesopo
9b349f8cc0
move typing.Callable def so Event doesn't have to be in " "
2019-10-29 18:00:59 +00:00
jesopo
40a340e94f
utils.cli shouldn't know about Database
2019-10-29 18:00:38 +00:00
jesopo
46e4b75f6b
utils.irc doesn't need to know about the whole of utils
2019-10-29 18:00:19 +00:00
jesopo
9f48dfb1f1
send_mode() args is already a list
2019-10-29 10:23:47 +00:00
jesopo
8983338680
move src/utils/irc/__init__.py to src/utils/irc.py
2019-10-28 10:57:19 +00:00
jesopo
7ee65f8f8c
remove src/utils/irc/protocol.py
2019-10-28 10:56:33 +00:00
jesopo
1bddc3b37f
Revert "remove unneeded import"
...
This reverts commit 8425c11c97
2019-10-27 10:32:13 +00:00
jesopo
8425c11c97
remove unneeded import
2019-10-27 10:25:37 +00:00
jesopo
8f4b5a0e70
move IRCLine related code from utils.irc to IRCLine.py
2019-10-27 10:19:00 +00:00
jesopo
3a755bb15f
don't consume past 2nd digit in e.g. "\03033,123"
2019-10-25 17:12:24 +01:00
jesopo
877287291a
reason arg of panic() shouldn't be optional, detect current exception
2019-10-25 14:31:09 +01:00
jesopo
b3f43a6721
remove bot.panic() throw kwarg
2019-10-25 14:27:12 +01:00
jesopo
226ebe1f1f
DEBUG log IRCBot.connect failure stacktrace
2019-10-25 14:18:22 +01:00
jesopo
7d4c6b6941
bot.panic() should just call sys.exit()
2019-10-25 14:14:30 +01:00
jesopo
9d1b640db4
re-add list moving CAP objects from capability_queue to capabilities_requested
2019-10-25 11:52:11 +01:00
Valentin Lorentz
d8c48fa98f
Make send_capability_queue split 'CAP REQ' message based on string length.
...
Instead of sending caps by groups of 10.
2019-10-23 21:20:56 +02:00
jesopo
062290704c
explicitly break event loop on Kill
2019-10-22 14:26:40 +01:00
jesopo
00e85c7573
bitbotctl stop should be keepalive so it exits when bitbotd exits
2019-10-18 11:29:59 +01:00
jesopo
f64131a10f
support utf8 hostnames by punycode (idna) encoding
2019-10-18 10:58:24 +01:00
jesopo
a1b8a4033a
hook_handler should be catching TRACE logging
2019-10-17 17:49:49 +01:00
jesopo
aa2511baaa
add IRCBot.stop() - use it for !shutdown and './bitbotctl stop'
2019-10-17 16:53:48 +01:00
jesopo
417c4f302e
default to using a "data directory" for bitbot (~/.bitbot/)
2019-10-17 12:39:56 +01:00
jesopo
b895958f09
remove debug prints from IRCBot
2019-10-15 16:16:29 +01:00
jesopo
aa3906dfa3
fix type linting issues for client in Control.is_readable
2019-10-14 18:17:15 +01:00
jesopo
88ffa421c1
add bitbotctl reload command to reload all modules
2019-10-14 14:52:58 +01:00
jesopo
99b4663ce7
run Control callbacks on main thread
...
closes #180
2019-10-14 14:51:53 +01:00
jesopo
e50290046a
remove safe arg from ModuleManager.load_modules() - try_reload_modules covers this now
2019-10-14 13:02:16 +01:00
jesopo
a9111c7241
add ModuleManager.try_reload_modules(), to try reloading in a transaction
...
if any of the modules fails to reload, rollback and use the already loaded modules. closes #179
2019-10-14 12:56:04 +01:00
jesopo
4940aff877
refactor out chosing loadable modules in to _list_valid_modules()
2019-10-14 11:37:04 +01:00
jesopo
2ca702b787
don't have version 'v' prefix in VERSION
2019-10-11 17:27:36 +01:00
jesopo
82f77472c6
'test_handler' -> 'hook_handler'
2019-10-11 17:17:43 +01:00
jesopo
14f5ec38ed
hold current version in it's own file: VERSION
2019-10-11 17:03:14 +01:00
jesopo
85a8ddf2d1
kill bitbotctl connection after rehash
2019-10-11 15:58:47 +01:00
jesopo
6a4cdabc93
add "rehash" bitbotctl command
2019-10-11 15:54:43 +01:00
jesopo
22b6a19054
try/except Control socket writes
2019-10-11 15:16:39 +01:00
jesopo
de389b34b8
add first real cli functionality: showing log
2019-10-11 15:12:26 +01:00
jesopo
cefde48e42
first draft of infrastructure for unix domain control socket
2019-10-11 14:00:26 +01:00
jesopo
daeb37226a
LockFile doesn't need to hold on to _database_location
2019-10-11 14:00:02 +01:00
jesopo
175f90f6a2
add "poll sources" - objects that can provide additional filenos for polling
2019-10-11 13:59:28 +01:00
jesopo
b7b045eadb
Don't exit when there are no connected servers
...
closes #175
2019-10-11 13:06:52 +01:00
jesopo
fd0baff093
only .call() PollHooks when they're "due"
2019-10-10 14:12:58 +01:00
jesopo
1c792f0194
move PoolHook registrations to start.py
2019-10-10 13:58:45 +01:00
jesopo
e624292608
v1.12.0 release
2019-10-10 13:36:55 +01:00
jesopo
a2b73469e6
v1.12.0-rc2 release
2019-10-10 12:43:19 +01:00
jesopo
5be01a45c4
'server.conncect_time' -> 'server.connect_time'
2019-10-10 12:31:24 +01:00
jesopo
2c19bdb949
add a fairly basic file locking mechanism with src/LockFile.py
...
closes #96
2019-10-10 12:11:03 +01:00
jesopo
0331b763ff
refactor multi-line-to-line normalisation to utils.parse.line_normalise(), use it in rss.py
...
closes #174
2019-10-10 10:33:18 +01:00
jesopo
51a4a4253c
-V command line arg should still effect stdout
2019-10-09 17:54:12 +01:00
jesopo
f721cf848a
stdout output should just be WARN - put INFO in to a daily file
...
this is because stdout, in something like systemd, will mess up journalctl output.
2019-10-09 17:36:17 +01:00
jesopo
ab2701837c
we should be catching timer as the output of self._timers.add
2019-10-09 12:47:03 +01:00
jesopo
a0870ad118
v1.12.0-rc1 release
2019-10-09 12:42:22 +01:00
jesopo
6ee2b6cf27
self.timers -> self._timers
2019-10-08 21:51:58 +01:00
jesopo
f8662ad6e1
fix IRCChannel.topic_setter type hint
2019-10-08 14:55:46 +01:00
jesopo
7a5edccb98
transient timers shouldn't use the event system
2019-10-08 13:49:55 +01:00
jesopo
4c02c7c86a
refactor anything that effects event poll timeout in to PollHook objects
2019-10-08 12:20:08 +01:00
jesopo
68aa89f16f
commit FunctionSetting changes i forgot to commit yesterday
2019-10-08 11:38:56 +01:00
jesopo
257042ac2c
combine find_user_settings() and find_user_settings_prefix()
2019-10-07 12:51:44 +01:00
jesopo
50d1eb6b8c
combine find_setting() and find_setting_prefix() on user/channel/server/bot
2019-10-07 12:46:52 +01:00
jesopo
9ab817ca58
parse out content_type in Response ctor
2019-10-05 22:56:56 +01:00
jesopo
b2473a4ac4
parse content-type out in utils.http.request, put it on Response object
2019-10-04 13:07:09 +01:00
jesopo
3466a3c43e
Allow utils.Setting_ parse functions to throw detailed errors
2019-10-04 10:25:48 +01:00
jesopo
f306213cb8
'is_localhost()' -> 'host_permitted()'
2019-09-30 15:15:20 +01:00
jesopo
b9c64b7cf1
use ipaddress is_loopback etc to do better forbidden ranges
...
closes #87
2019-09-30 15:12:01 +01:00
jesopo
8480309db2
only _kill() when there's no servers *and* the event queue is empty
...
this is so that bitbot doesn't exit when you !reconnect but only have 1 server
2019-09-30 11:52:07 +01:00
jesopo
a42a196720
only return IRCUser.hostmask() when all needed pieces are available
2019-09-27 16:21:59 +01:00
jesopo
82173a7d94
add external_modules directory
2019-09-27 16:03:06 +01:00
jesopo
16ba52f5dc
forgot to commit kwargs for get_user()
2019-09-27 15:52:25 +01:00
jesopo
7db17c0962
add utils.parse.try_int() because .isdigit() isnt good enough
2019-09-26 13:44:38 +01:00
jesopo
accd127ce5
add IRCBuffer.find_many_from()
2019-09-26 13:44:21 +01:00
jesopo
2f49fb99e9
assume http fallback_encoding by content-type (utf8 for json)
2019-09-25 15:32:09 +01:00
jesopo
47d38c7d18
refactor all checks for channel_type to server.is_channel()
2019-09-20 14:52:41 +01:00
jesopo
72649a90c2
only BeautifulSoup for finding encoding when it's a html-ish type
2019-09-20 13:38:00 +01:00
jesopo
d609bfb16d
cache calculated "next expiration" time
2019-09-20 11:47:57 +01:00
jesopo
efc0e197e5
Allow passing source Hostmask to IRCBatch
2019-09-19 18:16:10 +01:00
jesopo
e34259f967
log call was replaced with Exception but [] on args remained
2019-09-19 15:30:27 +01:00
jesopo
88a69aaa66
give Requests, use them in utils.http.request_many()
2019-09-19 14:54:44 +01:00
jesopo
d8e3a1c7ee
utils.http.request_() has no self, let alone self.log
2019-09-19 14:02:48 +01:00
jesopo
b69c9146b2
should be using pair_start/pair_end throughout for
2019-09-19 13:51:27 +01:00
jesopo
cd0d39ee5e
also show "bad" data in HTTPParsingException when a message is provided
2019-09-18 14:20:59 +01:00
jesopo
312f8906ae
show "bad" data in HTTPParsingException message
2019-09-18 10:52:05 +01:00
jesopo
a003c97fba
move q.close() to where it will be called even if deadline is hit
2019-09-18 10:24:01 +01:00
jesopo
dce6eee8c9
move _raise_deadline() out of except block to clean up printed stacktrace
2019-09-18 10:21:40 +01:00
jesopo
ee6360be22
don't check already-read data when checking for too-large requests
...
this check was here because the first read will return empty if it was an
invalid byte sequence for e.g. gzip because we needed to receive more data. the
second read will always return data (not decoded) so regardless of what the
already-read data is, the second read is the only criteria we need.
2019-09-17 17:33:23 +01:00
jesopo
1ac7f2697e
log which URL caused an error in request_many
2019-09-17 17:09:19 +01:00
jesopo
98545a9fb4
only decode content-types in DECODE_CONTENT_TYPES
2019-09-17 16:12:03 +01:00
jesopo
8ca0d30fef
Response.__init__() needs encoding now
2019-09-17 14:11:12 +01:00
jesopo
b7dd78ef1a
restore 5 second (instead of default 10) deadline for http.request
2019-09-17 13:44:14 +01:00
jesopo
94c3ff962b
use utils.deadline_process() in utils.http._request() so background threads can
...
call _request()
2019-09-17 13:41:11 +01:00
jesopo
fa95eaa9eb
add .get() to CaseInsensitiveDict
2019-09-17 13:40:37 +01:00
jesopo
d454f9b732
use Queue.get() with timeout, not Process.join() for timeout
...
this was because the threads spawned by multiprocessing.Queue seemed to be
making Process.join() believe the subprocess had not exited.
2019-09-17 13:39:23 +01:00
jesopo
1ed14f9a17
first draft of multiprocess.Process deadline system
2019-09-17 11:56:30 +01:00
jesopo
c23530be89
add missing IRCLine import to IRCChannel
2019-09-17 10:21:31 +01:00
jesopo
334d580c57
'seperate_hostmask()' -> 'parse_hostmask()'
2019-09-16 18:43:57 +01:00
jesopo
03892d0ae3
topic_setter should be stored as a Hostmask
2019-09-16 18:38:46 +01:00
jesopo
a48aececfd
EventRoot._hook's kwarg should be a list of tuples
2019-09-16 15:34:34 +01:00
jesopo
47735421b8
add json_body arg to Request to json-encode body, only return from body if
...
not null
2019-09-16 10:57:18 +01:00
jesopo
f9d13dc373
support '0' as an IntSetting value
2019-09-15 22:22:30 +01:00
jesopo
60ced118a0
get_user_status() -> get_user_modes(), filter in format_activity.py
2019-09-12 22:39:21 +01:00
jesopo
d950eb3660
add utils.SensitiveSetting, to .format() hide value
2019-09-12 12:17:31 +01:00
jesopo
ba0911f2e7
add utils.Setting.format() so subtypes can format differently
2019-09-12 12:17:09 +01:00
jesopo
9d33354d16
translate INVITE from [channel_name, target] to [target, channel_name]
2019-09-12 11:24:25 +01:00
jesopo
540c7b8c44
Revert "INVITE should be [channel_name, target]"
...
This reverts commit f3d8ffad2c
2019-09-12 11:23:29 +01:00
jesopo
f3d8ffad2c
INVITE should be [channel_name, target]
2019-09-12 11:21:29 +01:00
jesopo
77f50187c5
allow Requests to specify a useragent
2019-09-12 10:41:50 +01:00
jesopo
2c5a2d9db3
add IRCChannel.send_invite()
2019-09-12 10:24:02 +01:00
jesopo
2bd7d591c3
Revert "add IRCBot.http_client(), to allow modules to override default http client"
...
This reverts commit 81347fbba0
2019-09-11 18:08:44 +01:00
jesopo
81347fbba0
add IRCBot.http_client(), to allow modules to override default http client
2019-09-11 17:54:24 +01:00
jesopo
9d6a3982ed
add a helper utils.http.Client static object
2019-09-11 17:53:49 +01:00
jesopo
51dc26d113
add proxy to Request objects
2019-09-11 17:53:37 +01:00
jesopo
4a97c9eb0d
refactor utils.http.requests to support a Request object
2019-09-11 17:44:07 +01:00
jesopo
8f8cf92ae2
automatically decode certain http content types
2019-09-11 15:28:13 +01:00
jesopo
8d8d9219b8
don't return "+" when a channel has no modes
2019-09-10 15:10:14 +01:00
jesopo
a9b106c6be
Don't try to .decode non-html things, default iso-lat-1 for non-html too
2019-09-09 16:17:26 +01:00
jesopo
b83f5d9e30
add flag to disable encoding detection
2019-09-09 14:59:08 +01:00
jesopo
5ef2b7af27
'str.split' -> 's.split'
2019-09-09 14:53:11 +01:00
jesopo
1df82c1cb2
still default to iso-latin-1 if no on-page or in-header content-type is present
2019-09-09 14:48:26 +01:00
jesopo
0a67659637
only look for <meta>-related tags when there are meta tags
2019-09-09 14:39:19 +01:00
jesopo
0a1077c5cd
add explicit None return for _find_encoding (mypy)
2019-09-09 14:25:01 +01:00
jesopo
ff9c82bf67
change utils.http.request to best-effort detect on-page encoding
...
closes #113
2019-09-09 14:11:18 +01:00
jesopo
dadefeb8f3
remove try-rejoin (on 477) logic. will move to a module later
2019-09-07 15:21:35 +01:00
jesopo
d973b547e1
add a create flag to IRCChannels.get_id() to optionally not create new ids
2019-09-05 14:13:58 +01:00
jesopo
d7ae182428
cache when a setting isn't set but don't cache "default" value
2019-09-04 15:26:36 +01:00
jesopo
473c2723e7
only cache get_setting value when it's not the default value
2019-09-04 15:24:50 +01:00
jesopo
007bb78d30
make utils.from_pretty_time() format much stricter
2019-09-04 11:22:56 +01:00
jesopo
397cfa8e7e
correctly qualify DeadlineExceededException namespace
2019-09-03 14:54:59 +01:00
jesopo
b7b2f31c1c
use utils.deadline() in utils.http.request, not raw sigalrm
2019-09-02 15:50:21 +01:00
jesopo
d42d694e64
move deadline alarm time check inside try/finally
2019-09-02 15:50:12 +01:00
jesopo
a160148c2f
actually prune non-loadable modules before doing dependency checks
2019-09-02 15:46:31 +01:00
jesopo
43a7b7d949
add basic caching logic for channel settings
2019-09-02 14:07:39 +01:00
jesopo
7959f1ab88
change Cache.py to be key:value
2019-09-02 14:07:26 +01:00
jesopo
9cc1ee98eb
Pass the content of a webpage to HTTPParsingException
2019-09-02 13:27:44 +01:00
jesopo
408b89aeb7
use \S+ for url regex (for non-ascii chars), use url_sanitize to catch <>
2019-09-02 13:25:48 +01:00
jesopo
9e43ea1599
add per-user fediverse setting
2019-09-02 08:51:56 +01:00
jesopo
19d8f0b497
store and expose reconnection timers on IRCBot.reconnections
2019-09-01 08:38:22 +01:00
jesopo
6a068777d6
v1.11.1 release
2019-08-30 19:10:17 +01:00
jesopo
722d6418c8
switch to using signal.setitimer so we can restore previous timer
2019-08-30 18:36:48 +01:00
jesopo
a57a06b1cc
switch utils.deadline to a context manager
2019-08-30 18:13:12 +01:00
jesopo
e97e3c8f30
add utils.deadline(func, seconds) to put hard limits on code exec time
2019-08-30 17:17:03 +01:00
jesopo
4bfb4c3200
Add IntRangeSetting, reorder OptionsSetting arg order
2019-08-30 14:40:54 +01:00
jesopo
2c812ccaaa
Logging.BitBotFormatter no longer uses the format it's given (always iso8601)
2019-08-30 13:46:21 +01:00
jesopo
58a4fd7e74
round microseconds up to a whole number and zero-pad to 3 chars
2019-08-30 13:46:00 +01:00
jesopo
d3ed08e336
Don't use 'Z' for "utc timezone" - actually parse timezone out of datetimes
2019-08-30 13:25:19 +01:00
jesopo
b037c3076f
v1.11.0 release
2019-08-15 13:45:54 +01:00
jesopo
61eeba0cb9
should only return a BufferLineMatch when we actually match
2019-08-15 13:45:04 +01:00
jesopo
195cb66e26
Update CHANGELOG.md, bump version to v1.11.0-rc3
2019-08-14 15:17:01 +01:00
jesopo
814236915b
forgot to update IRCBot.VERSION to v1.11.0-rc2
2019-08-13 15:11:43 +01:00
jesopo
03c7e8f066
return matching string from buffer.find() as most uses were redundantly regexing
2019-08-13 13:48:03 +01:00
jesopo
0f4a4d04a1
v1.11.0-rc1 release
2019-08-09 15:02:10 +01:00
jesopo
b6361ba4e3
Remove extraneous space
2019-08-07 14:00:56 +01:00
jesopo
20042edfd9
Allow bypass of content-type check in utils.http.request
2019-08-05 15:41:02 +01:00
jesopo
d093027431
not all HTTP responses have content-type
2019-08-02 17:33:16 +01:00
jesopo
dd8b276b35
pull priority out of kwargs in _hook
2019-07-30 15:24:13 +01:00
jesopo
27a6078f20
Revert "hook priority position should default to 0, not end"
...
This reverts commit ff0cc59507
2019-07-30 15:23:13 +01:00
jesopo
5ffe2941e8
Revert "we should be checking if the new hook has a higher priority"
...
This reverts commit b145e664e1
2019-07-30 15:23:05 +01:00
jesopo
b145e664e1
we should be checking if the new hook has a higher priority
2019-07-30 15:12:29 +01:00
jesopo
ff0cc59507
hook priority position should default to 0, not end
2019-07-30 15:09:34 +01:00
jesopo
793fc94ea3
source should have ':' appended
2019-07-28 20:55:54 +01:00
jesopo
ad8f66c00e
Remove debug print
2019-07-28 18:14:44 +01:00
jesopo
163e979f95
move socket creation to it's own function, send event just prior to .connect
2019-07-28 18:07:23 +01:00
jesopo
9827feeabd
'name' -> 'key' (copypaste fail)
2019-07-28 18:07:01 +01:00
jesopo
25b507e80c
Refactor hook kwargs to be stored as a list of tuples to support key duplicates
...
closes #108
2019-07-28 12:35:04 +01:00
jesopo
77dfc76591
switch to function/module magic being a single object
2019-07-26 11:58:06 +01:00
jesopo
b6844303cb
add set_throttle(lines, seconds) function to tweak throttle per-server
2019-07-23 17:46:22 +01:00
jesopo
4babce5357
Only fill throttle when buffer is empty
2019-07-22 13:14:07 +01:00
jesopo
304fcdaebb
gotta str()-ify kwargs before logging it
2019-07-15 14:27:55 +01:00
jesopo
4815c1612c
don't silently truncate at newline in IRCLine.ParsedLine.truncate()
2019-07-15 14:26:45 +01:00
Mikaela Suomalainen
2f18414cb7
src/EventManager.py: fix typo defualt -> default
2019-07-13 13:04:37 +03:00
jesopo
89c12e845a
add --remove-server/-R cli arg
2019-07-12 09:30:22 +01:00
jesopo
ab45c65fb4
'self.channels' -> 'self._channels'
2019-07-11 14:22:33 +01:00
jesopo
02838e4802
Return new Timers
2019-07-09 11:16:34 +01:00
jesopo
32fa999c78
Allow Timer objects to be cancelled
2019-07-09 11:14:05 +01:00
jesopo
c19c6c0e14
asyncio.gather -> asyncio.wait (with timeout)
2019-07-08 14:50:11 +01:00
jesopo
469c725675
tell asyncio.gather which loop to use
2019-07-08 14:41:12 +01:00
jesopo
a1438abf66
close event loop when we're done with it (request_many())
2019-07-08 13:59:48 +01:00
jesopo
81c7af8ab5
Don't try/except async http exceptions
2019-07-08 13:51:02 +01:00
jesopo
ee0ec0eca1
switch request_many() to use asyncio.gather
2019-07-08 13:46:27 +01:00
jesopo
b62ba469d7
catch async exceptions in utils.http.request_many()
2019-07-08 13:18:59 +01:00
jesopo
078681eddf
add missing schema in utils.http.sanitise_url, use in rss.py
2019-07-08 12:54:06 +01:00
jesopo
ecb8364d0d
switch to using asyncio's event loop
2019-07-08 12:45:10 +01:00
jesopo
15e143fcff
implement utils.http.request_many as a tonado ioloop yield
2019-07-08 11:43:09 +01:00
jesopo
f9d5271762
"paramatered" -> "parametered"
2019-07-04 17:23:36 +01:00
jesopo
43c8ad0ff6
Add !editserver command
2019-07-04 13:15:51 +01:00
jesopo
3afbe5fd82
threading.Lock() around any access to _write_buffer
2019-07-04 06:56:05 +01:00
jesopo
76ab7935a0
return parsed modes from IRCChannel.parse_modes, pass through mode events
2019-07-03 08:13:28 +01:00
jesopo
637067c62c
url_validate() -> url_sanitise()
2019-07-02 14:15:49 +01:00
jesopo
534854127b
Add utils.http.url_validate() for best-effort url tidying
2019-07-02 14:10:18 +01:00
jan6
b6e9713a14
fixed capabilities
2019-07-01 14:41:47 +03:00
jesopo
19f716ab4c
Implemnt _options_factory for OptionsSetting to have dynamic options
2019-06-29 22:26:28 +01:00
jesopo
b4c762eb4e
Automatically format example text for OptionsSetting (showing options)
2019-06-29 21:33:26 +01:00
jesopo
7091860e54
Setting.__init__ call in OptionsSetting ctor needs self param
2019-06-28 23:27:56 +01:00
jesopo
756396d758
Implement utils.OptionsSetting
2019-06-28 23:26:42 +01:00
jesopo
ae9d099a41
Refactor set/channelset/serverset/botset in to 'utils.Setting' objects
2019-06-28 23:16:05 +01:00
jesopo
f9eb017466
message arg for HTTPWrongContentTypeException/HTTPParsingException
2019-06-28 23:01:21 +01:00
jesopo
97810db8df
Give descriptions to utils.http.HTTPException subclasses
2019-06-27 18:28:08 +01:00
jesopo
3c3f0449b6
add CaseInsensitiveDict.__contains__
2019-06-26 17:57:49 +01:00
jesopo
16d331dd43
add allow_redirects kwarg to utils.http.request()
2019-06-26 17:53:16 +01:00
jesopo
c5785a2d14
implement @utils.kwarg() magic, use it for command.regex hooks
2019-06-26 14:37:41 +01:00
jesopo
7060a0ac67
Update IRCBot except queue.Empty comment
2019-06-26 13:43:00 +01:00
jesopo
4bf5c4783b
Re-add EventManager check to prevent _call() outside main thread
2019-06-26 11:42:23 +01:00
jesopo
bb749b111f
Refactor EventManager to only hold hooks on a root object
2019-06-26 11:01:09 +01:00
jesopo
12181bfec6
Add system to have multiple url shorteners and chose which to use
2019-06-25 17:53:00 +01:00
jesopo
a1cc2e778c
Return 0 seconds if timeout seconds is negative
2019-06-24 17:22:08 +01:00
jesopo
ef0b3ec64c
move _check() after timeouted queue.get() so deadlines are met accurately
2019-06-23 20:50:40 +01:00
jesopo
dd1df4dc05
move get_poll_timeout() to event loop now that it is the one calling _check
2019-06-23 19:00:37 +01:00
jesopo
9673963a8d
shift _check() call to event loop function so read_loop needn't call trigger()
2019-06-23 18:53:25 +01:00
jesopo
102aa1dce1
v1.10.0 release
2019-06-23 14:45:56 +01:00
jesopo
afc287f020
Don't print BitBotPanic stacks when we don't need to
2019-06-23 10:01:15 +01:00
jesopo
7861210495
v1.10.0-rc2
2019-06-23 09:45:47 +01:00
jesopo
22574448da
until_read_timeout is a func - read_timed_out has always been returning false
2019-06-22 23:31:06 +01:00
jesopo
01bad3a76e
Don't needlessly call time.monotonic() when checking cache expirations
2019-06-22 23:30:15 +01:00
jesopo
7d49826b1a
v1.10.0-rc1
2019-06-22 22:41:17 +01:00
jesopo
f1abc5f10c
remove remove_own_mode( check - deferred_read.py better solves the issue.
...
the issue was getting a MODE line on irc.com prior to 001, thus we didn't know
what our nickname was thus we didn't know that the MODE was for us. not dying
when we saw +x was easy to do with this check but I think it's more correct to
actually parse that MODE after 001 so we know we have +x.
2019-06-22 22:23:05 +01:00
jesopo
3eac36d0f5
Restrict EventManager calls to the main thread
2019-06-22 12:21:44 +01:00
jesopo
a783e71ad4
return generated SentLine objects from IRCChannel.send_* functions
2019-06-21 18:25:21 +01:00
jesopo
90c90e5bbd
Implement dependency system for CAPs
2019-06-21 18:05:11 +01:00
jesopo
8a0d99f969
Adda system of aliases for CAPs, mostly for changeable draft specs and creating
...
dependence between moving specs
2019-06-21 17:15:46 +01:00
jesopo
bffc5b0ec4
WARN log when we try to remove a mode from ourselves that we didn't have
2019-06-21 11:16:53 +01:00
jesopo
01438f28f6
check we have a mode before trying to remove it
2019-06-21 11:14:10 +01:00
jesopo
e7b17f2ccd
give every ParsedLine a uuid4 .id for tracking purposes
2019-06-21 10:33:59 +01:00
jesopo
01ddc04bb9
fix hostmask_match_many type hinting
2019-06-20 17:58:49 +01:00
jesopo
b6e194a450
Implement hostmask_match_any, for more efficient matching of multiple hostmasks
2019-06-20 14:21:11 +01:00
jesopo
792a42be6e
Implement utils.irc.hostmask_match() as regex
2019-06-20 14:10:10 +01:00
jesopo
612c26ff7e
Differentiate between module "not found" and "not loaded"
2019-06-19 23:11:42 +01:00
jesopo
928f2f304d
Raise ModuleNotFoundException on failure to find_module()
2019-06-19 23:05:22 +01:00
jesopo
dc9cd2869f
Give requested module name to ModuleNotFoundException
2019-06-19 23:03:27 +01:00
jesopo
9457430c15
Add MessageTag.present, to see if a tag is present (even without value)
2019-06-19 22:36:42 +01:00
jesopo
938e1db963
add margin arg to ParsedLine.truncate so commands/outs.py doesn't do it
...
manually and cause potential issues with multi-byte chars
2019-06-19 10:34:42 +01:00
jesopo
c463fa20a4
line_formatted -> valid so tags don't cause us to subvert truncation
2019-06-18 18:14:04 +01:00
jesopo
1cbc2ce31b
Tags should not be appended to pieces now that they're counted separately
2019-06-18 17:56:20 +01:00
jesopo
aa4a15a6dc
Add IRCBot.URL ( https://bitbot.dev )
2019-06-18 17:33:54 +01:00
jesopo
51cac7d9b5
add has_tag() and get_tag() to IRCLine.ParsedLine
2019-06-18 15:18:44 +01:00
jesopo
31be78db81
message-tags count for a different character limit than the rest of the line
2019-06-18 14:33:51 +01:00
jesopo
621830c360
Simplify SentLine by shifting truncation to ParsedLine (and commands.outs)
2019-06-18 14:14:37 +01:00
jesopo
133ff1c0f6
only count "\n"s (not "\r\n") that hit the wire, incase \r\n gets cut in half
2019-06-17 18:23:38 +01:00
jesopo
d4391cc6c5
Fix Database.ChannelSettings.find SQL
2019-06-17 17:51:27 +01:00
jesopo
5c325d9b23
'break' instead of 'continue' so that things in the event queue get discarded
2019-06-17 16:19:20 +01:00
jesopo
72ce880478
Only panic() when a server connection is part of bot init. closes #69
2019-06-17 14:20:11 +01:00
jesopo
9121a868a8
Make sure we exit event loop when there's no servers left
2019-06-17 14:07:06 +01:00
jesopo
dbe0b1f43b
Tell servers objects when they are the result of a reconnection
2019-06-17 13:53:17 +01:00
jesopo
ec733e200c
Default IRCBot.running to false, set to true at the top of .run()
2019-06-17 11:35:45 +01:00
jesopo
da5d48400d
Change panic() reason log from ERROR to CRITICAL
2019-06-17 11:12:04 +01:00
jesopo
9ea356bc49
Raise a BitBotPanic() exception in panic()
2019-06-17 11:11:35 +01:00
jesopo
f8fa529ca5
Add IRCBot.panic() - a nicer interface for killing the whole application
2019-06-17 11:06:03 +01:00
jesopo
ced59a0f74
Allow channel-access and channel-mode check for channels people are not in
2019-06-16 20:48:31 +01:00
jesopo
18004c23e1
Don't fail get_kwarg when self.kwarg[name] is falsey
2019-06-16 18:39:56 +01:00
jesopo
5fa3d66a39
Return all caps through received.cap.ls|new and check if valid in line_handler,
...
remove server.cap_started
2019-06-16 15:33:20 +01:00
jesopo
919a488e86
Implement client-to-server BATCHes
2019-06-16 09:52:54 +01:00
jesopo
055eed24fd
Type annotate ParsedLine.tags, add ParsedLine.add_tag()
2019-06-16 09:52:25 +01:00
jesopo
8ab4880c5c
Change from yield checks to a func in events that pass up EventErrors
2019-06-15 18:42:14 +01:00
jesopo
b5a467552f
CRITICAL log exceptions caught in _loop_catch()
2019-06-15 00:39:52 +01:00
jesopo
e0d99fe8b1
Fix utils.Check args type hinting
2019-06-14 12:12:38 +01:00
jesopo
f05fc209b0
Add a way to __or__ utils.Checks, as a "if one of these passes" thing
2019-06-14 12:01:55 +01:00
jesopo
d7fa2cfa24
Catch yields in command callbacks for e.g. permission checks
2019-06-14 11:42:12 +01:00
jesopo
0e5ba747a9
Wrap _read_loop() and _write_loop() in a try that kills the main thread
2019-06-13 17:11:46 +01:00
jesopo
795f6afbeb
Mode mode (and mode arg) parsing to IRCChannel.py, add IRCChannel.mode_str
2019-06-13 11:53:47 +01:00
jesopo
8135f871c3
Change send_*() function return hints to be typing.Optional
2019-06-10 15:02:03 +01:00
jesopo
6c5dc958d0
Add .assure() to ParsedLine, to make it immune from .valid()
2019-06-10 10:45:02 +01:00
jesopo
0fc03fd592
Allow preprocess.send callbacks to request a line not be sent at all
2019-06-10 10:11:31 +01:00
jesopo
512d844a5a
Update CHANGELOG, v1.9.2 release
2019-06-09 17:34:45 +01:00
jesopo
a31793c851
Put responsbility of self.running = False on to the event loop
2019-06-09 14:59:28 +01:00
jesopo
e28a8d91ab
IRCServer.statusmsg type hint
2019-06-08 12:10:14 +01:00
jesopo
55fb9cee3b
v1.9.1 release
2019-06-08 11:03:18 +01:00
jesopo
d4ba98307f
We should look at ISUPPORT's STATUSMSG token instead of PREFIX
2019-06-08 10:59:52 +01:00
jesopo
16b9361371
Only request a CAP once. closes #66
2019-06-08 10:17:13 +01:00
jesopo
37c74da0f8
v1.9.0 release
2019-06-07 17:13:53 +01:00
jesopo
f822345976
Merge branch 'master' into feature/write-thread
2019-06-07 15:07:31 +01:00
jesopo
accd7a8941
Logging._log()'s params arg should be typing.Optiona[]
2019-06-07 13:35:20 +01:00
jesopo
ea924df883
typehint for IRCBuffer._lines
2019-06-07 13:34:30 +01:00
jesopo
bc4a6debb5
Use a deque for temp chathistory storage (src/IRCBuffer.py)
2019-06-07 13:31:51 +01:00
jesopo
38a41a6404
We need to wait for _check to finish so read/writes can be triggered correctly
2019-06-07 11:05:55 +01:00
jesopo
09fbbae5e3
"send" event on SentLines should be run on the main thread
2019-06-07 11:05:43 +01:00
jesopo
b3b4d07e63
Call _check *after* read epoll call - to make sure timeouts are hit accurately
2019-06-07 10:39:31 +01:00
jesopo
f3b6d6df0a
Switch to using threading.Condition to trigger write thread
2019-06-07 10:39:19 +01:00
jesopo
1f1b63ea6d
Checking if we should enable write buffer should be in _fill_throttle()
2019-06-07 08:02:22 +01:00
jesopo
c89bd74a48
select.poll, as opposed to select.epoll, uses milliseconds not seconds for
...
timeout
2019-06-06 23:45:33 +01:00
jesopo
23d2993b9f
Remove debug print
2019-06-06 23:25:03 +01:00
jesopo
6d44f12193
Use .trigger (without triggering read/write threads) to call _check
2019-06-06 23:23:46 +01:00
jesopo
24ca7ed97f
use trigger_write() instead of a raw .send(b"")
2019-06-06 23:19:57 +01:00
jesopo
ef0c2c65e0
use _event_queue for _check, don't .disconnect() from outside of respective
...
loops
2019-06-06 22:36:56 +01:00
jesopo
ae6c65d743
remove _trigger_function code, it's not used any more
2019-06-06 21:43:21 +01:00
jesopo
d9de4fdec2
Lambda scopes are irritating
2019-06-06 21:03:25 +01:00
jesopo
539bebafea
select.epoll -> select.poll
2019-06-06 20:26:05 +01:00
jesopo
0f7b040165
call timer callbacks and expire cach objects on main thread
2019-06-06 20:22:56 +01:00
jesopo
5b7d8dea91
Only trigger read/write threads once
2019-06-06 19:21:18 +01:00
jesopo
05fcb33ff7
print lines as soon as they're read, don't wait for _post_send
2019-06-06 19:15:34 +01:00
jesopo
f96378ac07
move immediate-write-trigger to IRCServer.py, trigger _event_loop for
...
running=False
2019-06-06 17:58:35 +01:00
jesopo
35b97f836a
Merge branch 'master' into feature/write-thread
2019-06-06 17:20:30 +01:00
jesopo
59eeee1030
message-tags are joined by ";", not ","
2019-06-06 17:19:27 +01:00
jesopo
a1ebe8035e
Split read/write/process in to 3 different threads
2019-06-06 17:05:44 +01:00
jesopo
2ca4fd48f7
Make params arg for logging functions optional
2019-06-06 12:59:47 +01:00
jesopo
eb7d90bb00
message_tag_escape() message-tag values when .format()ing IRCLine
2019-06-06 09:29:17 +01:00
jesopo
8fe5098739
Make 'circular dependency' WARN more explicitly about 1-to-1 dependencies
2019-06-05 19:13:44 +01:00
jesopo
67b4aa69e2
check_purge() after removing a context as it could make a hook purgable
2019-06-05 16:56:02 +01:00
jesopo
2d46fe0cbf
labels: Use BatchType to match, pass lines not line, batch ID isn't a label,
...
fire event on label response
2019-06-04 17:54:19 +01:00
jesopo
2470c1ec03
Add new BatchType object, to match like how Capability and MessageTag do
2019-06-04 17:51:55 +01:00
jesopo
8dbae6a5e9
Give SentLine (and preproc.send events) a new event object, to track events
...
related to a line after it is sent
2019-06-04 17:51:20 +01:00
jesopo
3ac01197f2
Send PING and PONG as 'immediate' lines
2019-06-04 14:31:34 +01:00
jesopo
4a4d0a37d7
Only return definitely-writen lines from IRCSocket._send, refactor in prep for
...
lines that request to be sent 'immediately'
2019-06-04 14:28:35 +01:00
jesopo
a802e66dcf
Defer decoding http payload bytestring until after checking ContentType
2019-06-04 13:47:03 +01:00
jesopo
ef221f4165
v1.8.0 release
2019-06-03 13:30:39 +01:00
jesopo
c212d70b68
Hold on to BATCH args, allow event hooks to manipulate batches
2019-06-02 15:18:36 +01:00
jesopo
5204ac3300
fix some CAP related type hints
2019-06-02 10:14:09 +01:00
jesopo
f9f637e084
Remove IRCSendBatch, fix some batch-related type hints
2019-06-02 10:13:51 +01:00
jesopo
20c027fd0b
check if we should enable write throttling before writing, clear _recent_sends
...
when we turn on throttling and only "turn on" throttling once
2019-06-01 22:28:57 +01:00
jesopo
b84d133500
add __str__ and __repr__ defs to IRCLine.ParsedLine
2019-06-01 22:28:37 +01:00
jesopo
e5c11f4aef
add 'module-blacklist/whitelist' to bot.conf - use that as well as DB setting
2019-06-01 15:06:57 +01:00
