You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-03 - 08:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Fri Apr 03, 2026 00:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
43560621590,3sleep375-21kworker/3:1-events22:41:343
2581692520,2sleep2161rcu_preempt19:41:392
4516502480,3sleep2451655-21unixbench_multi22:56:382
222125994637,6cyclictest268619-21latency_hist19:55:010
222138994334,7cyclictest3564575-21kworker/u8:1+flush-8:019:15:062
3978012410,2chrt0-21swapper/222:05:012
222125994034,4cyclictest234383-21apt-get19:21:210
222125993930,6cyclictest280-21systemd-journal22:15:000
222125993828,7cyclictest280-21systemd-journal23:14:000
21718923727,6sleep30-21swapper/319:05:493
3780402360,7sleep013-21ksoftirqd/021:46:250
222138993629,5cyclictest280-21systemd-journal19:33:382
222133993528,5cyclictest477104-21apt-get23:26:211
222125993530,3cyclictest180360-21kworker/u8:0+flush-8:020:36:400
222125993525,7cyclictest280-21systemd-journal22:10:000
21717623526,3sleep00-21swapper/019:05:370
222138993423,9cyclictest297439-21ntpq20:21:352
222125993428,4cyclictest317993-21latency_hist20:45:000
222125993424,8cyclictest280-21systemd-journal00:30:010
222125993327,4cyclictest313288-21kworker/u8:3+flush-8:020:51:370
222125993327,4cyclictest313288-21kworker/u8:3+flush-8:020:51:370
222138993226,5cyclictest3564575-21kworker/u8:1+events_unbound19:36:382
22213399328,12cyclictest332016-21ntpq20:56:361
222133993224,5cyclictest546027-21latency_hist00:35:011
222133993224,5cyclictest302296-21ntpq20:26:331
222133993222,8cyclictest500535-21ntpq23:46:361
222133993210,10cyclictest238324-21ps19:21:381
222125993228,2cyclictest258768-21kworker/u8:2+events_unbound21:16:430
222125993223,7cyclictest442477-21/usr/sbin/munin22:51:330
222125993222,8cyclictest280-21systemd-journal20:20:000
4126082310,4sleep10-21swapper/122:20:011
222138993123,6cyclictest525963-21grep00:11:422
222133993127,2cyclictest273534-21systemctl20:00:001
222133993123,6cyclictest280-21systemd-journal23:32:511
222133993123,6cyclictest280-21systemd-journal23:32:511
222133993121,7cyclictest336884-21ntpq21:01:331
222133993116,3cyclictest0-21swapper/121:41:311
222125993127,3cyclictest180360-21kworker/u8:0+flush-8:020:06:250
222138993025,3cyclictest263325-21unixbench_multi19:46:412
222133993024,4cyclictest347311-21unixbench_singl21:11:431
222133993018,6cyclictest161rcu_preempt00:26:281
222125993026,2cyclictest230351-21kthreadcore19:16:290
222125993024,4cyclictest367563-21sh21:35:000
22212599301,27cyclictest318594-21diskstats20:46:250
222138992924,3cyclictest343307-21fschecks_count21:11:272
22213399293,13cyclictest417813-21apt-get22:26:221
222133992924,3cyclictest382412-21apt21:50:001
222133992924,3cyclictest372517-21idleruntime-cro21:40:001
222133992924,3cyclictest1-21systemd23:10:001
222133992919,8cyclictest280-21systemd-journal23:05:001
222133992918,9cyclictest520561-21ntpq00:06:361
222133992918,3cyclictest161rcu_preempt23:21:241
222133992913,5cyclictest298260-21systemd-run20:25:001
222125992925,3cyclictest456996-21systemd-run23:05:000
222125992924,3cyclictest227136-21awk19:15:000
222125992921,5cyclictest280-21systemd-journal23:55:000
222138992822,4cyclictest312679-21unixbench_multi20:36:402
22213399289,4cyclictest428081-21sh22:36:271
22213399288,6cyclictest516505-21cut00:05:011
22213399284,14cyclictest278517-21idleruntime-cro20:05:001
222133992822,4cyclictest467236-21apt-get23:16:211
22213399282,14cyclictest288452-21latency_hist20:15:011
222133992820,6cyclictest447082-21latency_hist22:55:011
222133992819,6cyclictest407546-21latency_hist22:15:011
222133992817,2cyclictest161rcu_preempt22:46:321
222133992814,5cyclictest367761-21ls21:35:011
22213399280,8cyclictest421rcuog/220:46:261
222125992823,2cyclictest0-21swapper/000:00:010
222125992822,4cyclictest416962-21kworker/u8:1+flush-8:022:41:330
222125992822,4cyclictest273896-21apt-get20:01:210
222125992821,5cyclictest313288-21kworker/u8:3+flush-8:022:40:010
222125992818,8cyclictest353391-21diskstats21:21:270
22213399276,11cyclictest0-21swapper/122:31:311
22213399273,13cyclictest506454-21wc23:55:011
222133992723,2cyclictest521946-21cpuspeed_turbos00:11:251
222133992722,3cyclictest0-21swapper/123:41:291
22213399272,15cyclictest464417-21kthreadcore23:11:311
22213399272,11cyclictest247896-21taskset19:31:321
222133992715,3cyclictest0-21swapper/119:45:011
222125992722,4cyclictest427341-21cron22:35:000
222125992722,3cyclictest546055-21unin-run00:35:010
222125992721,4cyclictest531212-21sh00:20:000
222125992719,6cyclictest313288-21kworker/u8:3+events_unbound21:06:330
5478982260,4sleep10-21swapper/100:36:331
222138992623,2cyclictest492169-21fschecks_count23:41:252
222138992623,2cyclictest292964-21unixbench_singl20:16:422
222138992622,2cyclictest452448-21aten2_r5power_e23:01:242
222138992621,4cyclictest416962-21kworker/u8:1+events_unbound00:01:382
22213399267,9cyclictest362723-21date21:30:011
22213399264,14cyclictest355935-21cut21:21:331
222133992621,3cyclictest0-21swapper/122:05:001
222133992617,6cyclictest387579-21latency_hist21:55:011
222133992616,2cyclictest421rcuog/219:26:391
222133992613,3cyclictest161rcu_preempt19:15:031
22213399261,15cyclictest249210-21apt-get19:36:211
22213399261,13cyclictest451227-21ntpq22:56:321
222133992610,7cyclictest489747-21cut23:36:301
222125992622,2cyclictest0-21swapper/020:00:000
222125992621,3cyclictest387625-21systemd-run21:55:010
222125992619,5cyclictest313288-21kworker/u8:3+flush-8:020:56:380
222138992522,2cyclictest348473-21fschecks_count21:16:272
222138992521,2cyclictest457636-21fschecks_time23:06:262
222138992521,2cyclictest361757-21grep21:26:332
22213399251,9cyclictest509629-21grep23:56:311
222133992519,4cyclictest530907-21unixbench_singl00:16:421
222133992518,5cyclictest347602-21apt-get21:15:021
222133992513,5cyclictest0-21swapper/120:51:021
222133992513,5cyclictest0-21swapper/120:51:021
22213399251,13cyclictest531589-21apt-get00:21:211
22213399251,10cyclictest398052-21apt-get22:06:221
22213399251,10cyclictest264031-21apt-get19:51:221
222133992510,3cyclictest0-21swapper/119:11:291
22213399250,15cyclictest304945-21cut20:31:311
22213399250,14cyclictest318075-21sed20:45:001
22213399250,13cyclictest416623-21ntpq22:21:361
222125992521,2cyclictest520475-21needreboot00:06:330
222125992520,3cyclictest496112-21unixbench_multi23:41:420
222125992520,3cyclictest240259-21kthreadcore19:26:280
222125992519,4cyclictest258768-21kworker/u8:2+flush-8:020:21:380
22213899242,16cyclictest526657-21apt-get00:16:222
222138992420,2cyclictest378182-21fschecks_time21:46:272
222138992417,5cyclictest288348-21cat20:15:002
222138992416,6cyclictest511244-21apt-get00:00:002
22213399241,13cyclictest339263-21cut21:06:281
22213399240,14cyclictest308433-21apt-get20:36:201
22213399240,14cyclictest282554-21ntpq20:06:321
22213399240,13cyclictest261230-21grep19:46:301
22213399240,10cyclictest583-21snmpd22:40:551
222125992420,2cyclictest392485-21unixbench_singl21:56:430
222125992420,2cyclictest0-21swapper/021:15:010
222125992419,4cyclictest422417-21sh22:30:000
222125992419,4cyclictest416962-21kworker/u8:1+events_unbound22:46:320
222125992419,3cyclictest471788-21cron23:20:000
222125992417,5cyclictest253797-21latency_hist19:40:010
22212599240,22cyclictest476777-21unin-run23:25:000
222138992320,2cyclictest337443-21unixbench_singl21:01:402
222138992319,3cyclictest0-21swapper/222:20:002
222138992319,2cyclictest303789-21fschecks_count20:31:272
222138992318,4cyclictest422415-21kworker/u8:2+flush-8:023:21:272
22213399232,7cyclictest389345-21kthreadcore21:56:311
22213399231,12cyclictest291396-21kthreadcore20:16:311
22212599232,15cyclictest589-21runrttasks23:36:210
22212599231,9cyclictest2581702/usr/sbin/munin19:41:390
222125992319,3cyclictest461527-21unixbench_multi23:06:420
222125992316,5cyclictest546382-21apt-get00:36:240
222125992316,5cyclictest448354-21grep22:56:260
222125992316,4cyclictest3571713-21kworker/u8:3+flush-8:020:26:250
222125992314,7cyclictest512104-21diskstats00:01:240
222138992219,2cyclictest268245-21unixbench_multi19:51:402
222138992219,2cyclictest234673-21fschecks_count19:21:262
222138992218,2cyclictest368211-21fschecks_count21:36:262
222138992218,2cyclictest239424-21aten2_r5power_p19:26:222
22212599222,19cyclictest0-21swapper/019:46:390
222125992218,3cyclictest1-21systemd22:17:500
222125992217,4cyclictest481329-21unixbench_multi23:26:420
222125992213,7cyclictest525442-21ntpq00:11:340
22213899212,13cyclictest366784-21ntpq21:31:372
222138992117,2cyclictest0-21swapper/200:06:432
222138992116,4cyclictest422415-21kworker/u8:2+flush-8:023:16:402
222138992116,4cyclictest416962-21kworker/u8:1+events_unbound22:41:502
222138992115,4cyclictest505939-21unixbench_multi23:51:432
222138992115,4cyclictest416962-21kworker/u8:1+events_unbound00:36:312
222125992118,2cyclictest376836-21mailstats21:41:390
222125992117,2cyclictest0-21swapper/022:25:010
222125992116,4cyclictest416962-21kworker/u8:1+flush-8:023:33:220
222125992116,4cyclictest416962-21kworker/u8:1+flush-8:023:33:220
222125992113,6cyclictest280-21systemd-journal20:15:000
2171472214,11sleep10-21swapper/119:05:151
22213899202,13cyclictest541423-21apt-get00:31:222
22213899202,13cyclictest482015-21apt-get23:31:222
22213899202,13cyclictest482015-21apt-get23:31:222
22213899202,12cyclictest477104-21apt-get23:26:232
222138992017,2cyclictest353365-21cpuspeed_turbos21:21:262
222138992017,2cyclictest222767-21fschecks_time19:11:242
222138992016,2cyclictest0-21swapper/222:35:002
22213899200,5cyclictest536390-21latency_hist00:25:012
22212599209,9cyclictest0-21swapper/022:01:240
222125992016,3cyclictest0-21swapper/000:21:290
222125992015,3cyclictest0-21swapper/023:46:240
222125992015,3cyclictest0-21swapper/019:31:380
222125992014,4cyclictest258768-21kworker/u8:2+flush-8:021:01:380
222125992011,4cyclictest371639-21ntpq21:36:340
2176062203,10sleep20-21swapper/219:06:282
22213899199,7cyclictest372873-21apt-get21:41:212
222138991915,2cyclictest417843-21aten2_r5power_c22:26:242
222138991915,2cyclictest0-21swapper/222:11:392
222138991915,2cyclictest0-21swapper/220:30:002
222138991914,4cyclictest313288-21kworker/u8:3+flush-8:021:06:252
222138991914,3cyclictest0-21swapper/220:50:002
222138991910,7cyclictest271937-21tr19:56:322
22212599192,12cyclictest583-21snmpd20:31:380
222125991915,2cyclictest0-21swapper/021:26:220
22213899189,7cyclictest277058-21tr20:01:322
22213899188,8cyclictest325403-21tr20:51:302
22213899188,8cyclictest325403-21tr20:51:302
222138991815,2cyclictest497102-21fschecks_count23:46:262
222138991814,3cyclictest313288-21kworker/u8:3+events_unbound22:36:382
222138991814,3cyclictest0-21swapper/221:56:432
222138991812,4cyclictest0-21swapper/220:41:322
22213899181,13cyclictest382412-21apt-get21:50:032
4265922178,6sleep30-21swapper/322:31:403
22213899179,4cyclictest332461-21unixbench_singl20:56:402
222138991714,2cyclictest537448-21kthreadcore00:26:302
222138991713,2cyclictest0-21swapper/220:06:222
222138991711,3cyclictest466068-21ntpq23:11:362
4474352162,9sleep30-21swapper/322:56:203
2591012162,9sleep30-21swapper/319:46:223
22213899162,2cyclictest0-21swapper/222:21:362
222138991613,2cyclictest0-21swapper/223:37:172
222138991613,2cyclictest0-21swapper/222:05:112
222138991612,2cyclictest437654-21aten2_r5power_p22:46:242
222138991612,2cyclictest0-21swapper/222:51:372
3185902155,6sleep30-21swapper/320:46:263
4820182142,7sleep30-21swapper/323:31:233
4820182142,7sleep30-21swapper/323:31:233
3030052146,5sleep30-21swapper/320:28:243
3577682132,6sleep30-21swapper/321:25:023
3470102132,7sleep30-21swapper/321:11:423
3290962134,5sleep30-21swapper/320:56:293
3278472132,6sleep30-21swapper/320:55:003
3278472132,6sleep30-21swapper/320:55:003
2825422134,5sleep30-21swapper/320:06:333
5411142122,6sleep30-21swapper/300:30:023
5306402122,6sleep30-21swapper/300:16:423
5262922123,5sleep30-21swapper/300:15:013
5206202122,6sleep30-21swapper/300:06:383
5111522122,6sleep30-21swapper/323:59:043
4968172122,6sleep30-21swapper/323:46:243
4955342122,6sleep30-21swapper/323:41:343
4679642122,6sleep30-21swapper/323:16:293
4421952122,5sleep30-21swapper/322:50:023
4379932122,6sleep30-21swapper/322:46:283
4177432122,6sleep30-21swapper/322:25:503
3980562122,6sleep30-21swapper/322:06:233
3945612122,6sleep30-21swapper/322:01:303
3881702122,6sleep30-21swapper/321:56:243
3634282122,6sleep30-21swapper/321:31:283
3380712122,6sleep30-21swapper/321:06:193
3123232123,6sleep30-21swapper/320:36:383
2926152122,6sleep30-21swapper/320:16:403
2846272122,6sleep30-21swapper/320:11:303
2725332122,6sleep30-21swapper/319:56:333
2645192122,6sleep30-21swapper/319:51:283
2486742122,6sleep30-21swapper/319:32:493
2433482122,6sleep30-21swapper/319:26:403
5499342112,6sleep30-21swapper/300:36:363
5409472112,5sleep30-21swapper/300:28:373
5319672112,5sleep30-21swapper/300:21:273
5117302112,5sleep30-21swapper/300:00:033
5017562112,5sleep30-21swapper/323:51:253
4767682112,5sleep30-21swapper/323:25:013
4721362112,6sleep30-21swapper/323:21:163
4627112112,5sleep30-21swapper/323:11:293
4571962112,5sleep30-21swapper/323:05:023
4523632112,5sleep30-21swapper/323:01:213
4281682112,5sleep30-21swapper/322:36:293
4128072112,6sleep30-21swapper/322:20:483
4077692112,5sleep30-21swapper/322:15:023
4065532112,5sleep30-21swapper/322:11:333
3827292112,6sleep30-21swapper/321:50:023
3782882112,5sleep30-21swapper/321:46:293
3729052112,5sleep30-21swapper/321:41:233
3678932112,5sleep30-21swapper/321:36:223
3531452112,5sleep30-21swapper/321:21:253
3487172112,5sleep30-21swapper/321:16:313
3331462112,5sleep30-21swapper/321:01:223
3172192112,5sleep30-21swapper/320:41:363
3039072112,5sleep30-21swapper/320:31:293
2933172111,5sleep30-21swapper/320:20:013
2739002112,5sleep30-21swapper/320:01:233
2544082112,5sleep30-21swapper/319:41:253
2536322112,5sleep30-21swapper/319:38:083
2387032113,5sleep30-21swapper/319:21:423
2293982112,5sleep30-21swapper/319:16:203
2223242112,4sleep30-21swapper/319:10:023
4868242102,5sleep30-21swapper/323:35:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional