You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-18 - 13:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Mon May 18, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
282061995146,3cyclictest576850-21latency_hist23:55:021
282068994037,2cyclictest422051-21kworker/u8:0+flush-259:021:45:253
282061993632,3cyclictest608474-21apt-get00:25:111
282068993431,2cyclictest275832-21kworker/u8:2+events_unbound20:40:233
282068993430,3cyclictest385380-21kworker/u8:1+events_unbound21:10:253
282068993330,2cyclictest468620-21kworker/u8:0+events_unbound22:30:153
282068993129,1cyclictest587647-21kworker/u8:1+flush-259:000:30:263
28205799310,29cyclictest1-21systemd20:05:580
282068992926,2cyclictest385380-21kworker/u8:1+events_unbound21:53:583
282057992924,4cyclictest534640-21ntpq23:10:240
282068992720,2cyclictest530392-21kworker/u8:2+events_unbound23:40:203
282065992724,2cyclictest618580-21kworker/u8:3+flush-259:000:40:012
282068992624,1cyclictest411537-21kworker/u8:2+flush-259:021:25:243
282068992623,2cyclictest318341-21kworker/u8:0+flush-259:019:50:163
282068992522,2cyclictest499668-21kworker/u8:4+events_unbound23:30:153
282068992522,2cyclictest499668-21kworker/u8:4+events_unbound23:25:133
282068992522,2cyclictest468620-21kworker/u8:0+events_unbound22:15:243
282068992522,2cyclictest385380-21kworker/u8:1+events_unbound21:05:253
282068992522,2cyclictest364727-21kworker/u8:0+events_unbound20:45:233
282068992521,3cyclictest540886-21kworker/u8:3+events_unbound23:20:253
282061992519,4cyclictest252-21systemd-journal19:43:561
282068992421,2cyclictest364727-21kworker/u8:0+flush-259:020:50:253
282068992421,2cyclictest318341-21kworker/u8:0+events_unbound19:55:173
282068992421,2cyclictest281857-21kworker/u8:1+events_unbound20:20:153
282068992420,3cyclictest540886-21kworker/u8:3+events_unbound00:08:193
282068992420,3cyclictest411537-21kworker/u8:2+events_unbound21:20:243
282061992419,3cyclictest442713-21apt-get21:45:121
282068992320,2cyclictest468620-21kworker/u8:0+events_unbound22:20:243
282068992320,2cyclictest281857-21kworker/u8:1+events_unbound20:31:593
282068992319,3cyclictest385380-21kworker/u8:1+events_unbound20:56:583
282065992321,2cyclictest364727-21kworker/u8:0+events_unbound20:45:252
282065992320,2cyclictest468620-21kworker/u8:0+flush-259:023:00:002
282068992219,2cyclictest618580-21kworker/u8:3+events_unbound00:35:173
282068992218,3cyclictest587647-21kworker/u8:1+events_unbound00:27:593
282068992218,3cyclictest587647-21kworker/u8:1+events_unbound00:20:233
282068992218,3cyclictest411537-21kworker/u8:2+events_unbound22:29:573
282065992218,3cyclictest468620-21kworker/u8:0+flush-259:023:15:222
282057992218,3cyclictest370115-21apt-get20:35:120
282068992118,2cyclictest468620-21kworker/u8:0+flush-259:022:45:163
282068992118,2cyclictest364727-21kworker/u8:0+events_unbound20:35:223
282068992118,2cyclictest281857-21kworker/u8:1+events_unbound20:14:593
282068992118,2cyclictest281857-21kworker/u8:1+events_unbound20:05:263
282065992118,2cyclictest275832-21kworker/u8:2+flush-259:019:10:252
282065992115,4cyclictest411520-21latency_hist21:15:012
282061992115,4cyclictest252-21systemd-journal20:30:581
282061992111,9cyclictest396332-21apt-get21:00:121
282057992119,1cyclictest509753-21idleruntime-cro22:50:000
282057992118,2cyclictest484022-21idleruntime-cro22:25:000
282057992116,3cyclictest354451-21latency_hist20:20:000
282068992017,2cyclictest385380-21kworker/u8:1+events_unbound21:55:223
282065992017,2cyclictest499668-21kworker/u8:4+flush-259:023:45:012
282065992016,3cyclictest302967-21cat19:30:012
282065992016,3cyclictest234091-21kworker/u8:3+events_unbound19:15:232
282061992017,2cyclictest587620-21systemd-run00:05:001
282061992014,4cyclictest349294-21latency_hist20:14:591
282057992017,2cyclictest468620-21kworker/u8:0+flush-259:022:30:180
282068991916,2cyclictest540886-21kworker/u8:3+flush-259:023:50:153
282068991916,2cyclictest281857-21kworker/u8:1+events_unbound19:35:223
282065991916,2cyclictest468620-21kworker/u8:0+flush-259:022:30:222
282065991914,3cyclictest252-21systemd-journal00:33:462
282061991916,2cyclictest0-21swapper/123:20:001
282068991815,2cyclictest571725-21kworker/u8:0+events_unbound00:14:593
282068991815,2cyclictest566807-21apt-get23:45:133
282068991815,2cyclictest458341-21kworker/u8:3+events_unbound22:05:153
282068991815,2cyclictest411537-21kworker/u8:2+events_unbound22:10:233
282068991814,3cyclictest281857-21kworker/u8:1+events_unbound19:10:283
28206199184,11cyclictest494659-21cut22:35:111
282061991815,2cyclictest0-21swapper/121:30:001
282061991812,4cyclictest551008-21kworker/u8:1+flush-259:023:35:161
282061991810,7cyclictest324275-21irqcore19:50:171
28206199180,3cyclictest339023-21latency_hist20:05:011
28206199180,2cyclictest375019-21latency_hist20:40:011
282057991816,1cyclictest504626-21latency_hist22:45:000
282057991814,3cyclictest582677-21/usr/sbin/munin00:00:140
282057991813,4cyclictest510030-21apt-get22:50:110
282057991812,4cyclictest287409-21latency_hist19:15:000
282068991714,2cyclictest551008-21kworker/u8:1+flush-259:023:35:153
282068991714,2cyclictest411537-21kworker/u8:2+events_unbound21:40:213
282068991714,2cyclictest287431-21kworker/u8:4+events_unbound19:30:183
28206599175,6cyclictest484028-21munin-run22:25:002
282065991714,2cyclictest0-21swapper/200:00:002
282065991713,2cyclictest0-21swapper/200:05:002
282065991711,4cyclictest457464-21ntpq21:55:222
28206199177,9cyclictest0-21swapper/123:50:001
28206199175,10cyclictest613618-21apt-get00:30:141
28206199174,11cyclictest493843-21grep22:30:261
28206199171,5cyclictest566547-21apt23:45:001
282061991714,2cyclictest468609-21idleruntime-cro22:10:001
28206199171,3cyclictest458312-21cron22:00:001
28206199170,3cyclictest432140-21awk21:35:001
282057991713,3cyclictest489147-21sh22:30:000
282068991614,2cyclictest281857-21kworker/u8:1+events_unbound20:26:303
282068991614,1cyclictest0-21swapper/300:00:013
282068991613,2cyclictest587647-21kworker/u8:1+events_unbound00:17:583
282068991613,2cyclictest571725-21kworker/u8:0+flush-259:000:03:123
282068991613,2cyclictest499668-21kworker/u8:4+events_unbound23:00:583
282065991613,2cyclictest411537-21kworker/u8:2+flush-259:022:35:152
282065991613,2cyclictest313734-21fschecks_count19:40:152
282065991613,2cyclictest0-21swapper/222:50:002
28206199167,8cyclictest510255-21fschecks_time22:50:141
28206199165,10cyclictest380588-21cpuspeed_turbos20:45:141
28206199162,2cyclictest0-21swapper/123:30:001
28206199161,4cyclictest623750-21/usr/sbin/munin00:40:001
28206199161,4cyclictest417351-21irqcore21:20:181
28206199161,4cyclictest287410-21dump-pmu-power19:15:001
28206199161,4cyclictest252-21systemd-journal23:25:001
28206199161,3cyclictest603066-21awk00:20:001
28206199161,3cyclictest555738-21grep23:30:241
28206199161,3cyclictest504621-21sh22:45:001
28206199161,3cyclictest354438-21cron20:20:001
28206199161,3cyclictest319124-21sed19:45:181
28206199161,3cyclictest293278-21sed19:20:181
28206199161,2cyclictest529491-21ntpq23:05:231
282061991611,4cyclictest339543-21fschecks_time20:05:161
282061991610,4cyclictest281857-21kworker/u8:1+flush-259:019:15:181
28206199160,4cyclictest509785-21taskset22:50:001
28206199160,3cyclictest406388-21awk21:10:001
282057991614,1cyclictest60350irq/132-enp0s29f1:rx-019:50:260
282057991613,2cyclictest60350irq/132-enp0s29f1:rx-023:55:210
282057991613,2cyclictest60350irq/132-enp0s29f1:rx-021:55:210
282057991613,2cyclictest60350irq/132-enp0s29f1:rx-000:30:080
282057991612,3cyclictest525518-21apt-get23:05:120
282057991612,3cyclictest473745-21cron22:15:000
282057991612,3cyclictest468620-21kworker/u8:0+flush-259:023:00:250
282057991612,3cyclictest406635-21/usr/sbin/munin21:10:150
282068991512,2cyclictest61850irq/147-enp0s29f1:tx-722:54:433
282068991512,2cyclictest395849-21kworker/u8:3+flush-259:021:15:263
282068991511,3cyclictest468620-21kworker/u8:0+flush-259:023:10:003
282068991511,3cyclictest252-21systemd-journal19:16:583
28206599158,6cyclictest0-21swapper/220:00:012
282065991513,1cyclictest0-21swapper/222:10:002
282065991513,1cyclictest0-21swapper/221:00:002
282065991513,1cyclictest0-21swapper/200:15:002
282065991512,2cyclictest499668-21kworker/u8:4+flush-259:023:30:202
282065991512,2cyclictest478906-21latency_hist22:20:002
28206199159,4cyclictest308348-21/usr/sbin/munin19:35:231
28206199151,3cyclictest375418-21cpuspeed_turbos20:40:141
28206199151,2cyclictest525259-21turbostat.cron23:05:001
28206199151,2cyclictest479573-21ps22:20:171
28206199151,2cyclictest478904-21turbostat22:20:001
28206199151,2cyclictest463029-21grep22:00:251
28206199151,2cyclictest437659-21grep21:40:131
28206199151,2cyclictest410663-21ntpq21:10:231
28206199151,2cyclictest390765-21apt-get20:55:111
28206199151,2cyclictest0-21swapper/120:20:191
28206199151,2cyclictest0-21swapper/100:25:011
282061991512,2cyclictest308098-21idleruntime-cro19:35:001
28206199150,5cyclictest484508-21cut22:25:141
28206199150,5cyclictest363830-21awk20:25:201
28206199150,4cyclictest597460-21grep00:10:261
28206199150,4cyclictest530751-21cpuspeed_turbos23:10:151
28206199150,4cyclictest432831-21tail21:35:171
28206199150,4cyclictest302486-21grep19:25:251
28206199150,3cyclictest390488-21cron20:55:001
28206199150,3cyclictest329413-21grep19:55:161
28206199150,2cyclictest577957-21grep23:55:151
28205799158,5cyclictest420924-21ntpq21:20:230
282057991513,1cyclictest60350irq/132-enp0s29f1:rx-023:50:170
282057991513,1cyclictest60350irq/132-enp0s29f1:rx-022:57:300
282057991513,1cyclictest60350irq/132-enp0s29f1:rx-022:39:430
282057991513,1cyclictest60350irq/132-enp0s29f1:rx-022:05:110
282057991513,1cyclictest60350irq/132-enp0s29f1:rx-022:00:170
282057991513,1cyclictest60350irq/132-enp0s29f1:rx-021:30:160
282057991513,1cyclictest60350irq/132-enp0s29f1:rx-020:54:340
282057991513,1cyclictest60350irq/132-enp0s29f1:rx-019:40:240
282057991513,1cyclictest60350irq/132-enp0s29f1:rx-019:35:200
282057991513,1cyclictest60350irq/132-enp0s29f1:rx-019:20:220
282057991512,2cyclictest60350irq/132-enp0s29f1:rx-000:06:130
282057991512,2cyclictest453161-21cron21:55:000
282057991510,3cyclictest252-21systemd-journal00:22:570
282068991411,2cyclictest535719-21kworker/u8:1+events_unbound23:17:573
282068991411,2cyclictest499668-21kworker/u8:4+flush-259:022:55:153
282068991411,2cyclictest478927-21kworker/u8:1+events_unbound22:39:413
282068991411,2cyclictest422051-21kworker/u8:0+flush-259:021:30:193
28206599141,4cyclictest5419362kthreadcore23:20:182
282065991412,1cyclictest0-21swapper/222:05:002
282065991411,2cyclictest364697-21cron20:29:592
282065991411,2cyclictest349976-21irqcore20:15:172
282065991411,2cyclictest0-21swapper/220:44:592
28206599140,13cyclictest452297-21ntpq21:50:222
28206199142,2cyclictest515215-21apt-get22:55:131
28205799149,4cyclictest252-21systemd-journal22:19:570
28205799147,1cyclictest406405-21turbostat21:10:000
282057991413,1cyclictest60350irq/132-enp0s29f1:rx-023:39:350
282057991413,1cyclictest60350irq/132-enp0s29f1:rx-020:02:190
282057991412,1cyclictest60350irq/132-enp0s29f1:rx-021:40:210
282057991412,1cyclictest60350irq/132-enp0s29f1:rx-021:35:150
282057991412,1cyclictest60350irq/132-enp0s29f1:rx-021:00:270
282057991412,1cyclictest60350irq/132-enp0s29f1:rx-019:55:160
282057991412,1cyclictest60350irq/132-enp0s29f1:rx-019:26:030
282057991411,2cyclictest60350irq/132-enp0s29f1:rx-020:30:220
282057991410,3cyclictest252-21systemd-journal20:25:580
28206899139,3cyclictest364727-21kworker/u8:0+events_unbound21:03:403
282068991310,2cyclictest499668-21kworker/u8:4+events_unbound22:44:243
282068991310,2cyclictest458341-21kworker/u8:3+events_unbound22:00:033
282068991310,2cyclictest302503-21unixbench_singl19:25:253
28206599138,4cyclictest308111-21latency_hist19:35:002
282065991310,2cyclictest344622-21fschecks_time20:10:142
282065991310,2cyclictest282196-21gpgv19:10:012
282065991310,2cyclictest275832-21kworker/u8:2+events_unbound20:05:162
282057991312,1cyclictest60350irq/132-enp0s29f1:rx-023:24:180
282057991312,1cyclictest60350irq/132-enp0s29f1:rx-021:15:230
282057991311,1cyclictest60350irq/132-enp0s29f1:rx-023:40:410
282057991311,1cyclictest60350irq/132-enp0s29f1:rx-000:15:180
282057991311,1cyclictest60350irq/132-enp0s29f1:rx-000:10:150
282057991311,1cyclictest571862-21latency_hist23:50:000
282057991310,2cyclictest60350irq/132-enp0s29f1:rx-021:25:210
282057991310,2cyclictest60350irq/132-enp0s29f1:rx-019:30:250
282057991310,2cyclictest391178-21tr20:55:150
282057991310,2cyclictest0-21swapper/023:35:000
28206899129,2cyclictest411537-21kworker/u8:2+events_unbound21:36:353
28206899129,2cyclictest318341-21kworker/u8:0+events_unbound19:45:263
28206899127,3cyclictest339029-21awk20:05:003
282068991210,2cyclictest468620-21kworker/u8:0+events_unbound23:10:023
28206599129,2cyclictest572229-21fschecks_time23:50:152
28206599129,2cyclictest437619-21cpuspeed_turbos21:40:132
28206599129,2cyclictest401564-21cpuspeed_turbos21:05:152
28206599129,1cyclictest0-21swapper/220:25:002
28206599127,4cyclictest608214-21latency_hist00:25:022
28206599127,4cyclictest252-21systemd-journal21:47:572
28206599127,3cyclictest252-21systemd-journal20:39:572
282065991210,1cyclictest548385-21kthreadcore23:25:182
282065991210,1cyclictest416675-21sh21:20:002
282065991210,1cyclictest0-21swapper/219:20:182
28205799129,2cyclictest60350irq/132-enp0s29f1:rx-020:45:130
282057991211,1cyclictest60350irq/132-enp0s29f1:rx-019:45:280
282057991211,1cyclictest60350irq/132-enp0s29f1:rx-000:37:390
282057991210,1cyclictest60350irq/132-enp0s29f1:rx-021:46:480
282057991210,1cyclictest60350irq/132-enp0s29f1:rx-019:15:180
282057991210,1cyclictest0-21swapper/019:10:010
282057991210,1cyclictest0-21swapper/000:25:240
28205799120,4cyclictest357606-21grep20:20:190
28206599119,1cyclictest0-21swapper/221:20:202
28206599118,2cyclictest602199-21ntp_kernel_pll_00:15:222
28206599118,2cyclictest587950-21cpuspeed_turbos00:05:142
28206599118,2cyclictest468929-21cpuspeed_turbos22:10:142
28205799119,1cyclictest60350irq/132-enp0s29f1:rx-020:40:140
28206599108,1cyclictest0-21swapper/220:00:142
28206599107,1cyclictest0-21swapper/220:30:172
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional