Michael Scire
5217e6b9f3
kern: devirtualize KAutoObjectWithList::GetId()
2021-10-26 01:11:15 -07:00
Michael Scire
4aefb1163c
kern: fix reorder-init in KHandleTable
2021-10-26 01:11:15 -07:00
Michael Scire
62bdae5b3f
kern: devirtualize most things that are free to devirtualize (see #1672 )
2021-10-26 01:11:15 -07:00
Michael Scire
6dbdfa0384
kern: use optimized red black tree finds for remaining holdouts
2021-10-26 01:11:14 -07:00
Michael Scire
7749ecabc4
kern: devirtualize several KAutoObject functions
2021-10-26 01:11:14 -07:00
Michael Scire
d3ad53a525
kern: devirtualize remaining vcall for class token/dyncast
2021-10-26 01:11:13 -07:00
SciresM
823c0df6b9
kern: avoid constexpr init for many objects (avoids unnecessary memory clear) ( #1668 )
2021-10-26 01:11:13 -07:00
Michael Scire
00353a05e9
kern: use new AtomicRef, use Atomic<bool>
2021-10-26 01:11:13 -07:00
Michael Scire
0d1ec0739f
util: better match true std::atomic semantics
2021-10-26 01:11:13 -07:00
Michael Scire
d3b358bbb9
kern/util: use custom atomics wrapper to substantially improve codegen
2021-10-26 01:11:12 -07:00
Michael Scire
6f9d5ecd0d
kern: use 13.0.0 revised KLightLock logic
2021-10-26 01:11:12 -07:00
Michael Scire
d9d6d52575
kern: remove spurious assertion
2021-10-26 01:11:12 -07:00
Michael Scire
573769303b
kern: update scheduler for 13.0.0 change, fix some ctz/clz bugs
2021-10-26 01:11:11 -07:00
Michael Scire
2827f6300e
kern: fix use of plr vs plr_heap, fix close/unlock order in ArbitrateLock
2021-10-26 01:11:11 -07:00
Michael Scire
960c5c19f9
ams: improve offsetof style consistency
2021-10-26 01:11:10 -07:00
Michael Scire
e9c82af25f
kern: remove need for explicit reserved member in KAutoObject
2021-10-26 01:11:10 -07:00
Michael Scire
f8d59254cf
kern: devirtualize KAutoObject::DynamicCast<>()
...
This is an optimization that saves the most common type of virtual call in the kernel (DynamicCast)
by storing class token as a member, rather than getting it via virtual call every time.
This does not currently cost any memory space on 64-bit targets, due to pre-existing padding space.
This optimization can be turned off via a compile-time flag for accuracy.
2021-10-26 01:11:09 -07:00
Michael Scire
05c7ba6439
kern/util: update structure layouts to match Nintendo (saves 0x10 per KThread/KSession)
2021-10-26 01:11:09 -07:00
Michael Scire
65e89cf1b8
kern: fix some lingering non-m_ member variables
2021-10-15 23:54:35 -07:00
Michael Scire
f6c9839eae
kern: tidy up capability calc
2021-10-15 23:54:32 -07:00
Michael Scire
390ce66da1
svc: refactor/rename MemoryInfo fields
2021-10-07 23:06:28 -07:00
Michael Scire
002422d5dc
ams: the copyright^H^H^H^H^H^H^Hmplex plane is the algebraic closure of the reals
2021-10-07 23:06:25 -07:00
Michael Scire
8ecddf498a
kern: use util::BitFlagSet for capability flags
2021-10-07 23:06:18 -07:00
Michael Scire
dbbd04fd2c
kern: fix/update thread permissions on pin
2021-10-07 23:06:18 -07:00
Michael Scire
204b389252
kern: devirtualize page table operations
2021-09-24 09:17:11 -07:00
Michael Scire
993ffbfdcd
kern: unify all waiting semantics to use single api
2021-09-19 10:35:39 -07:00
Michael Scire
ecb607bade
kern/svc: implement IoPool/Region svc support
2021-09-19 10:35:39 -07:00
Michael Scire
b579a6d75e
svc/kern/dd: remove MapDeviceAddressSpace()
2021-09-19 10:35:39 -07:00
Michael Scire
3e328eae72
kern: update Initialize0 for new arguments/randomization semantics
2021-09-19 10:35:38 -07:00
Michael Scire
f103b6876b
kern: KMemoryManager/KPageGroup use physical addresses instead of virtual, now
2021-09-19 10:35:38 -07:00
Michael Scire
1ac249dd13
kern: support dynamic resource expansion for system heaps/events/sessions.
2021-09-19 10:35:38 -07:00
Michael Scire
5a41163576
kern: improve kdebug attach semantics
2021-09-19 10:35:38 -07:00
Michael Scire
ccdee05857
kern: update KPageTable::Unmap block closing logic
2021-09-19 10:35:38 -07:00
Michael Scire
62655a9e3b
kern: optimize logging for release kernel strings (saves printf space in .text)
2021-09-19 10:35:37 -07:00
Michael Scire
22bb619873
kern: add new KMemoryState
2021-09-19 10:35:37 -07:00
Michael Scire
010fb5986e
kern: KWorkerTaskManager no longer tracks id
2021-09-19 10:35:37 -07:00
Michael Scire
2913096bc4
kern: kill the interrupt task manager thread
2021-09-19 10:35:36 -07:00
Michael Scire
ccbca5fb57
kern: remove per-KInterruptEventTask locks
2021-09-19 10:35:36 -07:00
Michael Scire
2361bee5fe
kern: delete KWritableEvent, devirtualize KReadableEvent Signal/Clear
2021-09-19 10:35:36 -07:00
Michael Scire
cbec3828bf
kern: KConditionVariable arbiter functions now static
2021-09-19 10:35:36 -07:00
Michael Scire
94fa7524ff
kern: KAutoObject doesn't need (virtual) destructor
2021-09-19 10:35:35 -07:00
Michael Scire
8939693d33
kern: optimize handle table layout
2021-09-19 10:35:35 -07:00
Michael Scire
e9a80d95e7
kern: optimize hw-single-step management
2021-09-19 10:35:29 -07:00
Michael Scire
33d58424c7
kern: add hardware single step extension
2021-09-19 10:35:28 -07:00
Michael Scire
525254b32b
kern: update initial cache management to match latest kernel
2021-08-20 13:33:58 -07:00
Michael Scire
2a98931260
kern: fix handling of is_aligned parameter in DevicePageTable
2021-07-06 07:28:32 -07:00
Michael Scire
765c854768
kern: implement improved [new page tables are zero] invariant
2021-07-06 07:28:30 -07:00
Michael Scire
5785447252
kern: ensure InitArguments do not cross page boundaries
2021-07-06 07:28:29 -07:00
Michael Scire
d8e35f2277
exo/meso: update for gcc 11 compatibility
2021-04-29 03:04:54 -07:00
Michael Scire
c34109718f
kern: fix initial process binary load on 2.0.0-4.1.0 ( closes #1460 )
2021-04-29 03:04:54 -07:00
Michael Scire
2ccba9adbb
util: implement red black trees as templates over macros
2021-04-29 03:04:53 -07:00
Michael Scire
049c56f75a
kern: fix constant evaluation correctness, codegen tweak
2021-04-29 03:04:53 -07:00
Michael Scire
71e8931b89
kern: tweak KHandleTable codegen
2021-04-29 03:04:52 -07:00
Michael Scire
c8ca3ecccd
kern: tweak KAutoObject::Open/Close codegen
2021-04-29 03:04:52 -07:00
Michael Scire
53693dfb17
kern: add names/links to kern_assembly_offsets.h
2021-04-29 03:04:52 -07:00
Michael Scire
e238fa426d
kern: mostly kill magic numbers in assembly, fix SVCs >= 0x80
2021-04-29 03:04:51 -07:00
Michael Scire
f863ad0a32
kern: mesosphere now implements kernel/sdk 12.3
2021-04-11 03:59:20 -07:00
Michael Scire
e9d44eb71a
kern: fuck the KPolice^H^H^H^H^H^HPageGroups
2021-04-11 03:59:20 -07:00
Michael Scire
44621eeb57
kern: who needs __purecall?
2021-04-11 03:59:19 -07:00
Michael Scire
0162133f1e
kern: update pinning semantics for terminating threads
2021-04-11 03:59:19 -07:00
Michael Scire
863008ab54
kern: ensure handle table is finalized when deferring termination
2021-04-11 03:59:19 -07:00
Michael Scire
b1b8944ccd
kern: update port/session state semantics
2021-04-11 03:59:17 -07:00
Michael Scire
94dce392ff
kern: update KLightConditionVariable
2021-04-11 03:59:17 -07:00
Michael Scire
f9cd04c7c4
kern: optimize KHandleTable to use indices instead of pointers
2021-04-11 03:59:17 -07:00
Michael Scire
7c35303c62
kern: KAutoObject destruction is now scheduled for next dpc-time
2021-04-11 03:59:16 -07:00
Michael Scire
13ddcae970
kern: update for new slab resource counts/extents
2021-04-11 03:59:16 -07:00
Michael Scire
cf19a7b64d
kern: load initial process binary from user pool, rather than from pt heap
2021-04-11 03:59:15 -07:00
Michael Scire
3ebf91304e
kern: update Initialize0 for new changes
2021-04-11 03:59:15 -07:00
Michael Scire
50ce41adf2
kern: use KScopedLightLockPair helper for page table pair-locks
2021-04-11 03:59:12 -07:00
Michael Scire
43900d4765
kern: track mapped ipc server memory in page table
2021-04-11 03:59:12 -07:00
Michael Scire
8df6062a1d
kern: add KPageTableBase::Read/WriteDebugIoMemory
2021-04-11 03:59:12 -07:00
Michael Scire
6eda131ab6
kern: update KMemoryBlockManagerUpdaterAllocator for new ctor/init semantics
2021-04-11 03:59:11 -07:00
Michael Scire
e2f21cbd84
kern: swap tpidr_el1/cntv_cval_el0 as scratch vs exception stack
2021-04-11 03:59:11 -07:00
Michael Scire
c39bce4620
kern: support immortal processes
2021-04-11 03:59:10 -07:00
Michael Scire
ec7e3fb07f
kern: update process/thread for new running/termination semantics
2021-04-11 03:59:10 -07:00
Michael Scire
be127dfc4b
kern: update KInterruptEvent to store core id
2021-04-11 03:59:09 -07:00
Michael Scire
f11f6ec313
kern: update pinned thread priority rules
2021-04-11 03:59:09 -07:00
Michael Scire
d44aa9cb5d
kern: update KInitialPageTable/KInitialPageAllocator
2021-04-11 03:59:08 -07:00
Michael Scire
e597eb5411
kern: KLinkedList no longer exists
2021-04-11 03:59:08 -07:00
Michael Scire
af72072313
kern: bump svc limit to 192 from 128
2021-04-11 03:59:07 -07:00
Michael Scire
9b47aa6e08
ams: prefer construct_at/destroy_at over placement new/explicit destructor
2021-04-11 03:59:04 -07:00
Michael Scire
1861791c1c
ams: remove TYPED_STORAGE() macro in favor of template
2021-04-11 03:59:03 -07:00
Michael Scire
832f0f441d
kern: fix support for virtual core IDs
2021-02-15 19:51:57 -08:00
Michael Scire
b3eef9315b
kern: further codegen tweaks
2021-01-13 10:41:27 -08:00
Michael Scire
ca5e69f16d
kern: greatly improve codegen for atomics, scheduler
2021-01-13 10:41:26 -08:00
Michael Scire
d247e742b8
kern: remove target-firmware logic for kernel loader
2020-12-29 13:07:57 -08:00
Michael Scire
bb30453d43
kern: fix KTrace buffer memory region type to match official kernel
2020-12-28 17:34:07 -08:00
Michael Scire
4ddacf3384
kern: refactor to use m_ for member variables
2020-12-19 10:21:52 -08:00
Michael Scire
a73cdcad21
kern: fix generic KDevicePageTable
2020-12-19 10:21:51 -08:00
Michael Scire
84ca5c4aab
kern: fix LegacyNFiq interrupt ID
2020-12-19 10:21:50 -08:00
Michael Scire
c9933de735
kern: fix linear region printing output
2020-12-19 10:21:50 -08:00
Michael Scire
cdbf881e99
kern: implement process cpu utilization debug
2020-12-19 10:21:47 -08:00
Michael Scire
02453fc15f
kern: add page table contents debug
2020-12-19 10:21:46 -08:00
Michael Scire
e80707f2df
kern: update for 11.0.1
2020-12-11 03:49:02 -08:00
Michael Scire
eb621c6aae
kern: implement memory debug
2020-12-11 03:49:02 -08:00
Michael Scire
7519d17941
kern: add kernel object debug
2020-12-11 03:49:01 -08:00
Michael Scire
4c0b780017
kern: implement port debug
2020-12-11 03:49:01 -08:00
Michael Scire
f3882fa0f7
kern: add handle table/process/suspend/resume debug
2020-12-11 03:49:01 -08:00
Michael Scire
9784530bcf
kern: implement thread call stack debug
2020-12-11 03:49:00 -08:00
Michael Scire
a7b7dd1257
kern: add debug thread dump
2020-12-11 03:49:00 -08:00
Michael Scire
3355f97275
exo/meso/fusee: support dynamic control of log port/baud rate
2020-12-11 03:48:58 -08:00
Michael Scire
45c1b044d3
kern: tweak KScopedAutoObject
2020-12-02 06:53:23 -08:00
Michael Scire
7901f15d20
kern: allow non-inline GetObjectForIpc
2020-12-02 06:53:23 -08:00
Michael Scire
8cac1203be
kern: fix KHandleTable null deref in ipc
2020-12-02 06:53:22 -08:00
Michael Scire
b53ee81bab
kern: session mapping getters are on the hotpath
2020-12-02 06:53:22 -08:00
Michael Scire
9d51004a9b
kern: fix bugs caused by UB + transition to -Os
2020-12-02 06:53:19 -08:00
Michael Scire
ca24d0ed9f
kern: allow non-inline KSchedulerLock::Lock
2020-12-02 06:53:19 -08:00
Michael Scire
a911d2da7e
kern: build as -Os instead of -O2
2020-12-02 06:53:18 -08:00
Michael Scire
b5eb0bb978
kern: assume that uart has been setup by secmon
2020-12-02 06:53:18 -08:00
Michael Scire
a15f3ba468
kern: update Initialize0 to account for new ordering
2020-12-02 06:53:17 -08:00
Michael Scire
0eb6e0a963
kern: add new overflow checks on KMemoryRegions
2020-12-02 06:53:17 -08:00
Michael Scire
2db30d4d46
kern: improve KMemoryManager pool detection
2020-12-02 06:53:17 -08:00
Michael Scire
0b36215bfa
kern: update KMemoryRegion to store last address rather than size
2020-12-02 06:53:16 -08:00
Michael Scire
2d1ebf4406
kern: add KAlpha/KBeta
2020-12-02 06:53:16 -08:00
Michael Scire
02bea1a3f2
kern: remove now unused SetupFor*Compare funcs
2020-12-02 06:53:16 -08:00
Michael Scire
c24ba715b4
KConditionVariable/KAddressArbiter: no need for global compare thread
2020-12-02 06:53:15 -08:00
Michael Scire
e4774a2685
kern: implement 64-virtual-core interface
2020-12-02 06:53:15 -08:00
Michael Scire
a57c7f7a48
kern: cleanup KThread, optimize/normalize KThreadQueue/KWaitObject
2020-12-02 06:53:14 -08:00
Michael Scire
a01f7ab1c9
kern: improve KSynchronizationObject, kill KSynchronization
2020-12-02 06:53:14 -08:00
Michael Scire
1806dc45ee
kern: update for new interrupt event locking scheme
2020-12-02 06:53:13 -08:00
Michael Scire
1582110af7
kern: KObjectContainer::Register -> void
2020-12-02 06:53:12 -08:00
Michael Scire
0c73792282
kern: Kill KCoreLocalRegion
2020-12-02 06:53:12 -08:00
Michael Scire
43a0706e96
kern: remove more of clc
2020-12-02 06:53:12 -08:00
Michael Scire
7b9b9b7a7a
kern: move scheduler/interrupt task manager out of core local region
2020-12-02 06:53:12 -08:00
Michael Scire
f36d24e1ed
kern: update KHardwareTimer, move out of KCoreLocalRegion
2020-12-02 06:53:11 -08:00
Michael Scire
8ec3f47a80
kern: use single interrupt manager object
2020-12-02 06:53:11 -08:00
Michael Scire
d0b05d0e4e
kern: fix re-order/assert in KMemoryBlock
2020-12-02 06:53:10 -08:00
Michael Scire
f8999a2318
kern: remove KPageTableBase::MakeAndOpenContiguousPageGroup
2020-12-02 06:53:10 -08:00
Michael Scire
397d317a6c
kern: implement DisableDeviceAddressSpaceMerge
2020-12-02 06:53:10 -08:00
Michael Scire
0063ede635
kern: SvcGetResourceLimitPeakValue
2020-12-02 06:53:10 -08:00
Michael Scire
396dc066e9
kern: KMemoryManager::Allocate -> AllocateAndOpen
2020-12-02 06:53:09 -08:00
Michael Scire
1260d85bb9
kern: implement kmemoryblock/kmemoryinfo merge disable
2020-12-02 06:53:09 -08:00
Michael Scire
dd799d3909
kern: remove KMemoryAttribute_AnyLocked
2020-12-02 06:53:09 -08:00
Michael Scire
f152b16639
kern: update KMemoryBlockManagerUpdateAllocator api
2020-12-02 06:53:09 -08:00
Michael Scire
5f885a3b22
kern: implement new software-reserved page table bits
2020-12-02 06:53:08 -08:00
Michael Scire
394112f9ac
kern: update KPageTableBase for new disable-merge attrs
2020-12-02 06:53:08 -08:00
Michael Scire
0f3085b8f6
kern: perform rescheduling on dispatch re-enable ( closes #1169 )
2020-10-26 16:03:08 -07:00
Michael Scire
0b7648e7fc
kern: default to release config
2020-09-17 08:34:22 -07:00
Michael Scire
ba45f73e40
kern: generate fatal error on panic
2020-09-17 08:34:22 -07:00
Michael Scire
b4dbd97381
kern: skeleton legacy lps driver
2020-09-07 10:51:51 -07:00
Michael Scire
22f2946671
kern: begin 1.0.0 backwards compat changes (kips run, full boot fails)
2020-09-07 10:51:50 -07:00
Michael Scire
1aedaa0f91
kern: support 2-pool layout on 2.x-4.x instead of modern 4-pool layout
2020-09-07 10:51:50 -07:00
Michael Scire
6cf1e0cece
kern: change terminology metadata -> management
2020-09-07 10:51:50 -07:00
Michael Scire
0c246b88bd
kern: pool management should be within carveout
2020-09-07 10:51:49 -07:00
Michael Scire
d61f1ddef7
kern: fix phys/virt pool management mixup
2020-09-07 10:51:49 -07:00
Michael Scire
00a43ac776
kern: revamp KMemoryRegionType to better encode derivation hierarchies
2020-09-07 10:51:49 -07:00
Michael Scire
ae14cf51b5
kern: PMC must be user-mappable for 1.0.0 compat
2020-09-07 10:51:48 -07:00
Michael Scire
ec6535bd4b
kern: fix warn-errors
2020-09-07 10:51:47 -07:00
Michael Scire
8b88149742
kern: fix KTypedAddress, strengthen assertions
2020-09-07 10:51:46 -07:00
Michael Scire
658b92e17a
kern: add version bounds checking
2020-09-07 10:51:45 -07:00
