You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-12 - 19:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Tue May 12, 2026 12:44:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1563515995753,3cyclictest1600557-21gpgv07:45:003
1563510995552,2cyclictest1766766-21kworker/u8:2+flush-259:010:50:222
1563510995249,2cyclictest1751418-21kworker/u8:1+events_unbound10:10:132
1563510995148,2cyclictest1563463-21kworker/u8:3+events_unbound07:25:252
1563505994844,3cyclictest1870750-21kworker/u8:0+flush-259:012:10:210
1563515994742,3cyclictest1751418-21kworker/u8:1+flush-259:010:20:163
1563510994743,3cyclictest1854826-21kworker/u8:1+flush-259:012:05:182
1563507994741,4cyclictest252-21systemd-journal11:59:371
1563510994642,3cyclictest1508818-21kworker/u8:2+events_unbound07:50:252
1563515994539,4cyclictest1678686-21/usr/sbin/munin09:00:243
1563510994441,2cyclictest1508818-21kworker/u8:2+events_unbound07:40:192
1563510994340,2cyclictest1699066-21kworker/u8:0+events_unbound10:15:232
1563507994336,4cyclictest252-21systemd-journal09:14:371
1563505994339,3cyclictest1584678-21kworker/u8:0+flush-259:008:40:000
1563505994339,3cyclictest1584678-21kworker/u8:0+flush-259:008:40:000
1563505994237,4cyclictest1636823-21kworker/u8:3+events_unbound09:33:390
1563515994136,4cyclictest1584878-21apt-key07:30:023
1563510994138,2cyclictest1870750-21kworker/u8:0+events_unbound12:35:012
1563510994138,2cyclictest1595222-21kworker/u8:1+flush-259:008:50:232
1563505994137,3cyclictest1595222-21kworker/u8:1+flush-259:008:45:010
1563505994137,3cyclictest1595222-21kworker/u8:1+flush-259:008:45:000
1563505994135,4cyclictest1704862-21cp09:25:010
1563510994037,2cyclictest1870750-21kworker/u8:0+flush-259:012:15:232
1563510994037,2cyclictest1782230-21kworker/u8:4+flush-259:010:55:252
1563510994037,2cyclictest1595222-21kworker/u8:1+flush-259:008:25:242
1563510993936,2cyclictest1508818-21kworker/u8:2+events_unbound08:10:212
1563510993933,4cyclictest1905859-21ntpq12:35:232
1563507993934,4cyclictest1508818-21kworker/u8:2+flush-259:007:30:011
1563505993936,2cyclictest1751418-21kworker/u8:1+flush-259:010:15:010
1563505993935,3cyclictest1636823-21kworker/u8:3+flush-259:008:30:000
1563515993835,2cyclictest1595222-21kworker/u8:1+flush-259:008:50:173
1563515993832,4cyclictest1787394-21latency_hist10:45:003
1563510993835,2cyclictest1595222-21kworker/u8:1+flush-259:008:00:252
1563515993733,3cyclictest1595222-21kworker/u8:1+flush-259:008:25:173
1563510993734,2cyclictest1766766-21kworker/u8:2+flush-259:010:45:242
1563510993734,2cyclictest1595222-21kworker/u8:1+flush-259:008:20:182
1563515993631,4cyclictest1766766-21kworker/u8:2+flush-259:011:05:253
1563510993633,2cyclictest1823469-21kworker/u8:0+flush-259:011:30:162
1563510993633,2cyclictest1766766-21kworker/u8:2+flush-259:011:20:232
1563505993633,2cyclictest1730328-21kworker/u8:3+events_unbound09:59:370
1563505993629,4cyclictest1745790-21apt-get10:05:010
1563510993533,2cyclictest1720067-21kworker/u8:1+events_unbound09:45:252
1563510993532,2cyclictest1563463-21kworker/u8:3+events_unbound07:30:272
1563507993529,4cyclictest1906695-21latency_hist12:40:001
1563505993531,3cyclictest1699066-21kworker/u8:0+events_unbound10:30:170
1563510993432,1cyclictest1636823-21kworker/u8:3+events_unbound08:30:142
1563510993431,2cyclictest1699066-21kworker/u8:0+events_unbound09:31:372
1563510993430,3cyclictest1766766-21kworker/u8:2+flush-259:011:10:302
1563510993430,3cyclictest1766766-21kworker/u8:2+flush-259:011:10:302
1563507993430,3cyclictest1699066-21kworker/u8:0+flush-259:010:30:001
1563507993428,4cyclictest1642224-21/usr/sbin/munin08:25:151
1563507993427,5cyclictest1704219-21apt-get09:25:001
1563505993430,3cyclictest1860568-21kworker/u8:2+events_unbound12:23:400
1563505993430,3cyclictest1839292-21kworker/u8:1+flush-259:011:35:380
1563510993331,2cyclictest1595222-21kworker/u8:1+flush-259:008:45:232
1563510993330,2cyclictest1854826-21kworker/u8:1+events_unbound12:00:162
1563510993330,2cyclictest1699066-21kworker/u8:0+flush-259:009:40:242
1563510993330,2cyclictest1636823-21kworker/u8:3+events_unbound08:40:202
1563510993330,2cyclictest1636823-21kworker/u8:3+events_unbound08:40:192
1563505993330,2cyclictest1699066-21kworker/u8:0+flush-259:010:35:190
1563505993330,2cyclictest1595222-21kworker/u8:1+flush-259:008:20:140
1563505993329,3cyclictest1766766-21kworker/u8:2+events_unbound11:04:590
1563505993327,4cyclictest1651437-21ntpq08:30:200
1563515993226,4cyclictest1616187-21latency_hist08:00:013
1563510993230,2cyclictest1782230-21kworker/u8:4+flush-259:011:00:262
1563510993230,2cyclictest1699066-21kworker/u8:0+events_unbound09:55:082
1563510993229,2cyclictest3700495-21kworker/u8:0+events_unbound07:15:152
1563510993229,2cyclictest1751418-21kworker/u8:1+events_unbound10:25:382
1563510993229,2cyclictest1636823-21kworker/u8:3+events_unbound09:00:162
1563510993229,2cyclictest1508818-21kworker/u8:2+flush-259:007:20:212
1563505993228,3cyclictest1870750-21kworker/u8:0+events_unbound12:05:380
1563505993228,3cyclictest1636823-21kworker/u8:3+events_unbound08:54:380
1563505993226,2cyclictest1595222-21kworker/u8:1+flush-259:008:45:150
1563510993129,2cyclictest1844231-21kworker/u8:3+events_unbound11:45:362
1563510993128,3cyclictest3700495-21kworker/u8:0+events_unbound07:13:382
1563510993128,2cyclictest1730328-21kworker/u8:3+events_unbound10:00:262
1563510993128,2cyclictest1595222-21kworker/u8:1+flush-259:008:55:162
1563510993127,2cyclictest1-21systemd10:35:002
1563510993124,5cyclictest1656511-21ntpq08:35:202
1563510993124,5cyclictest1656511-21ntpq08:35:192
1563507993128,2cyclictest1595222-21kworker/u8:1+events_unbound07:50:191
1563505993127,3cyclictest1844231-21kworker/u8:3+events_unbound11:50:370
1563505993127,3cyclictest1508818-21kworker/u8:2+events_unbound08:15:150
1563505993127,3cyclictest1508818-21kworker/u8:2+events_unbound07:55:370
1563505993126,4cyclictest1694172-21apt-get09:15:120
1563515993026,3cyclictest1860568-21kworker/u8:2+flush-259:011:55:193
1563515993026,3cyclictest1563463-21kworker/u8:3+flush-259:007:40:003
1563515993024,4cyclictest252-21systemd-journal12:08:373
1563510993028,2cyclictest1823469-21kworker/u8:0+flush-259:011:25:212
1563510993028,2cyclictest1508818-21kworker/u8:2+flush-259:007:35:202
1563510993027,2cyclictest1595222-21kworker/u8:1+events_unbound09:10:222
1563510993027,2cyclictest1595222-21kworker/u8:1+events_unbound07:57:392
1563510993026,3cyclictest1823469-21kworker/u8:0+events_unbound11:38:382
1563510993026,3cyclictest1699066-21kworker/u8:0+events_unbound10:35:212
1563507993023,5cyclictest1886143-21latency_hist12:20:011
1563505993026,3cyclictest1508818-21kworker/u8:2+events_unbound08:11:370
1563515992925,3cyclictest1745818-21gpgv10:05:013
1563505992926,3cyclictest1782230-21kworker/u8:4+events_unbound11:41:380
1563505992926,2cyclictest1720067-21kworker/u8:1+events_unbound09:48:380
1563505992926,2cyclictest1636823-21kworker/u8:3+events_unbound09:20:250
1563505992925,3cyclictest1854826-21kworker/u8:1+flush-259:012:15:130
1563505992924,4cyclictest1823434-21apt-get11:20:000
1563515992823,3cyclictest252-21systemd-journal08:40:373
1563515992823,3cyclictest252-21systemd-journal08:40:363
1563510992825,2cyclictest1782230-21kworker/u8:4+events_unbound11:44:392
1563510992825,2cyclictest1766766-21kworker/u8:2+events_unbound11:15:372
1563510992825,2cyclictest1636823-21kworker/u8:3+events_unbound09:09:382
1563510992824,3cyclictest1699066-21kworker/u8:0+events_unbound09:25:122
1563507992824,3cyclictest1823457-21gpgv11:20:001
1563507992824,3cyclictest1787654-21apt-get10:45:111
1563507992824,3cyclictest1508818-21kworker/u8:2+flush-259:007:35:161
1563505992825,2cyclictest1766766-21kworker/u8:2+flush-259:010:50:240
1563505992824,3cyclictest1823469-21kworker/u8:0+events_unbound11:24:380
1563505992822,4cyclictest252-21systemd-journal12:35:480
1563515992724,2cyclictest1595222-21kworker/u8:1+flush-259:009:00:013
1563515992723,3cyclictest1636823-21kworker/u8:3+flush-259:008:49:573
1563515992721,4cyclictest1563429-21latency_hist07:10:013
1563510992724,3cyclictest1595222-21kworker/u8:1+events_unbound07:45:372
1563510992724,2cyclictest1766766-21kworker/u8:2+events_unbound11:09:372
1563510992724,2cyclictest1595222-21kworker/u8:1+events_unbound09:24:392
1563510992723,3cyclictest1766766-21kworker/u8:2+events_unbound10:43:382
1563510992723,3cyclictest1508818-21kworker/u8:2+flush-259:008:15:172
1563505992724,2cyclictest1595222-21kworker/u8:1+events_unbound09:01:380
1563505992723,3cyclictest1508818-21kworker/u8:2+events_unbound07:40:220
1563505992720,5cyclictest1625569-21ntpq08:05:220
1563515992624,1cyclictest1508818-21kworker/u8:2+events_unbound07:15:003
1563510992623,2cyclictest1709813-21kworker/u8:2+events_unbound09:50:192
1563505992623,2cyclictest3700495-21kworker/u8:0+events_unbound07:20:150
1563505992623,2cyclictest1860568-21kworker/u8:2+flush-259:012:25:230
1563515992519,4cyclictest1704452-21gpgv09:25:013
1563510992522,2cyclictest1860568-21kworker/u8:2+flush-259:012:20:182
1563507992519,4cyclictest1578457-21ntpq07:20:221
1563505992522,2cyclictest1766766-21kworker/u8:2+events_unbound10:40:190
1563515992420,3cyclictest1823469-21kworker/u8:0+flush-259:011:20:173
1563515992418,4cyclictest1802803-21latency_hist11:00:013
1563510992420,3cyclictest1699066-21kworker/u8:0+flush-259:010:05:212
1563510992419,4cyclictest252-21systemd-journal12:10:372
1563507992420,3cyclictest1508818-21kworker/u8:2+flush-259:007:49:591
1563505992421,2cyclictest1595222-21kworker/u8:1+flush-259:008:55:260
1563505992420,3cyclictest1860568-21kworker/u8:2+events_unbound11:55:180
1563505992420,3cyclictest1782230-21kworker/u8:4+events_unbound11:47:380
1563505992420,3cyclictest1766766-21kworker/u8:2+events_unbound10:49:380
1563515992320,2cyclictest1699066-21kworker/u8:0+flush-259:009:40:013
1563510992322,1cyclictest1595222-21kworker/u8:1+flush-259:008:05:252
1563507992318,4cyclictest1678019-21apt-get09:00:001
1563507992317,4cyclictest1853924-21ntpq11:45:221
1563507992317,4cyclictest1782205-21sh10:39:591
1563505992320,2cyclictest1595222-21kworker/u8:1+events_unbound07:45:130
156350599231,21cyclictest1-21systemd11:07:370
1563515992218,3cyclictest1746335-21base6410:05:023
1563515992218,3cyclictest1595222-21kworker/u8:1+flush-259:009:10:003
1563515992216,4cyclictest1870707-21latency_hist12:05:013
1563510992219,2cyclictest1860568-21kworker/u8:2+events_unbound12:25:142
1563507992219,2cyclictest1595222-21kworker/u8:1+flush-259:009:25:011
1563507992218,3cyclictest1611307-21apt-get07:55:121
1563507992217,4cyclictest1803071-21apt-get11:00:131
1563507992217,4cyclictest1746425-21cp10:05:011
1563505992217,4cyclictest1860568-21kworker/u8:2+events_unbound12:02:380
1563515992116,4cyclictest1725449-21apt-get09:45:113
1563515992114,5cyclictest1792768-21/usr/sbin/munin10:50:153
1563507992117,3cyclictest1595222-21kworker/u8:1+flush-259:009:15:241
1563507992115,4cyclictest1824094-21/usr/sbin/munin11:20:151
1563505992118,2cyclictest1636823-21kworker/u8:3+flush-259:009:05:250
1563510992017,2cyclictest1699066-21kworker/u8:0+flush-259:009:35:162
1563510992015,3cyclictest1860446-21base6411:55:002
1563507992015,4cyclictest1839535-21apt-get11:35:131
1563505992017,2cyclictest1563463-21kworker/u8:3+flush-259:007:25:170
1563505992014,4cyclictest252-21systemd-journal07:33:370
1563515991916,2cyclictest3700495-21kworker/u8:0+flush-259:007:15:173
1563515991916,2cyclictest1595222-21kworker/u8:1+events_unbound08:05:163
1563515991915,3cyclictest507-21in:imuxsock08:34:593
1563515991915,3cyclictest252-21systemd-journal12:33:373
1563515991915,3cyclictest1782230-21kworker/u8:4+flush-259:011:50:003
1563510991916,2cyclictest1595222-21kworker/u8:1+events_unbound09:15:192
1563507991915,3cyclictest1766766-21kworker/u8:2+flush-259:011:10:001
1563507991915,3cyclictest1636823-21kworker/u8:3+flush-259:008:31:081
1563507991915,3cyclictest1595222-21kworker/u8:1+flush-259:008:40:261
1563507991915,3cyclictest1595222-21kworker/u8:1+flush-259:008:40:261
1563507991913,4cyclictest252-21systemd-journal11:42:361
1563507991913,4cyclictest1667719-21latency_hist08:50:001
1563505991917,2cyclictest1636823-21kworker/u8:3+events_unbound09:35:050
1563505991916,2cyclictest3700495-21kworker/u8:0+flush-259:007:15:210
1563505991915,3cyclictest1689058-21apt-get09:10:120
1563505991915,2cyclictest0-21swapper/010:10:000
1563515991816,1cyclictest0-21swapper/308:25:003
1563507991814,3cyclictest1772143-21/usr/sbin/munin10:30:201
1563507991813,4cyclictest1751418-21kworker/u8:1+flush-259:010:10:181
1563507991812,4cyclictest252-21systemd-journal10:54:591
1563507991812,4cyclictest1735465-21latency_hist09:55:011
1563505991815,2cyclictest1782230-21kworker/u8:4+flush-259:010:55:230
1563505991815,2cyclictest1709813-21kworker/u8:2+flush-259:009:50:190
1563505991815,2cyclictest1699066-21kworker/u8:0+flush-259:010:15:240
1563505991814,3cyclictest3700495-21kworker/u8:0+flush-259:007:10:270
1563505991814,3cyclictest1823469-21kworker/u8:0+flush-259:011:25:180
1563505991814,3cyclictest1751418-21kworker/u8:1+events_unbound10:27:390
1563515991715,1cyclictest0-21swapper/312:30:003
1563515991714,2cyclictest1563463-21kworker/u8:3+flush-259:007:25:213
1563515991713,2cyclictest0-21swapper/309:15:013
1563515991711,4cyclictest1720286-21/usr/sbin/munin09:40:203
1563507991713,3cyclictest3700495-21kworker/u8:0+flush-259:007:20:001
1563507991711,4cyclictest1631897-21/usr/sbin/munin08:15:201
1563507991711,4cyclictest1616422-21/usr/sbin/munin08:00:151
1563505991714,2cyclictest1508818-21kworker/u8:2+flush-259:008:04:590
1563515991614,1cyclictest0-21swapper/307:50:003
1563515991613,1cyclictest0-21swapper/310:20:003
1563515991612,3cyclictest1699066-21kworker/u8:0+flush-259:009:55:163
1563515991611,4cyclictest1823547-21gpgv11:19:593
1563510991613,2cyclictest1844231-21kworker/u8:3+events_unbound11:53:212
1563507991612,3cyclictest1730328-21kworker/u8:3+flush-259:010:00:331
1563507991612,3cyclictest1699066-21kworker/u8:0+flush-259:009:32:421
1563507991611,4cyclictest1839267-21latency_hist11:35:011
1563507991610,1cyclictest0-21swapper/112:25:001
1563505991613,2cyclictest1508818-21kworker/u8:2+events_unbound07:35:180
1563505991612,3cyclictest1870750-21kworker/u8:0+events_unbound12:33:380
1563515991511,3cyclictest1870750-21kworker/u8:0+flush-259:012:15:243
1563515991511,3cyclictest1860568-21kworker/u8:2+flush-259:012:35:263
1563515991511,3cyclictest1699066-21kworker/u8:0+flush-259:009:25:173
1563510991511,3cyclictest1699066-21kworker/u8:0+events_unbound10:24:572
1563507991513,1cyclictest0-21swapper/107:15:001
1563507991512,2cyclictest1875843-21idleruntime-cro12:10:001
1563507991512,2cyclictest1866195-21irqcore12:00:171
1563507991512,2cyclictest1720031-21idleruntime-cro09:40:011
1563507991511,3cyclictest1859910-21latency_hist11:55:011
1563505991513,1cyclictest60350irq/132-enp0s29f1:rx-009:43:190
1563505991512,2cyclictest60350irq/132-enp0s29f1:rx-007:50:260
1563505991512,2cyclictest0-21swapper/011:10:250
1563505991512,2cyclictest0-21swapper/011:10:240
1563505991511,3cyclictest1751418-21kworker/u8:1+flush-259:010:20:220
156351599149,3cyclictest1508818-21kworker/u8:2+flush-259:008:15:253
1563515991410,3cyclictest1823469-21kworker/u8:0+flush-259:011:40:263
1563515991410,3cyclictest1782230-21kworker/u8:4+flush-259:011:00:233
1563515991410,3cyclictest1766766-21kworker/u8:2+flush-259:011:10:163
1563515991410,3cyclictest1766766-21kworker/u8:2+flush-259:011:10:163
1563515991410,2cyclictest1575885-21kthreadcore07:20:183
156350799149,4cyclictest252-21systemd-journal08:24:501
156350799149,3cyclictest1631664-21latency_hist08:15:001
1563507991410,3cyclictest1782230-21kworker/u8:4+flush-259:010:45:001
156351599139,3cyclictest1616514-21cpuspeed_turbos08:00:143
156351599137,4cyclictest1771889-21cron10:29:593
156350799131,10cyclictest1818320-21munin-run11:15:001
156350799131,10cyclictest1818320-21munin-run11:14:591
1563507991310,2cyclictest832-21runrttasks08:05:171
1563507991310,2cyclictest1724741-21unixbench_singl09:40:241
156351599129,2cyclictest1855462-21cut11:50:173
156351599129,2cyclictest1772590-21irqcore10:30:163
156351599129,2cyclictest1610572-21unixbench_multi07:50:263
156351599127,4cyclictest1584678-21kworker/u8:0+flush-259:008:15:013
1563515991210,1cyclictest0-21swapper/312:20:123
156350799126,4cyclictest252-21systemd-journal09:05:001
156351599118,1cyclictest0-21swapper/311:30:123
156351599111,7cyclictest1844464-21cron11:40:003
156350799119,1cyclictest1896703-21cpuspeed_turbos12:30:121
156350799118,2cyclictest1870750-21kworker/u8:0+flush-259:012:10:131
156350799118,2cyclictest1756819-21cpuspeed_turbos10:15:141
156350799117,3cyclictest1683894-21apt-get09:05:121
156350799117,3cyclictest0-21swapper/107:45:001
156350799115,5cyclictest1672883-21latency_hist08:55:011
156351599108,1cyclictest0-21swapper/310:35:153
156350799108,1cyclictest0-21swapper/107:30:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional