You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-12 - 09:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackeslot8s.osadl.org (updated Wed Nov 12, 2025 00:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32936749912970,1294cyclictest36253762sleep323:00:013
32936749912160,1213cyclictest34720472sleep321:24:563
32936749912160,1213cyclictest34720472sleep321:24:563
32936749911940,1190cyclictest37312182sleep300:04:563
32936749911650,1161cyclictest33146802sleep319:24:573
32936749911410,1138cyclictest34035932sleep320:34:563
32936749910893,1082cyclictest3577710-21sleep22:30:013
3293674993731,368cyclictest3780082-21turbostat00:39:563
37330102180,1sleep00-21swapper/000:05:170
3293674991815,1cyclictest0-21swapper/322:35:273
3293674991815,1cyclictest0-21swapper/300:33:433
3293674991815,1cyclictest0-21swapper/300:25:013
132298180,4rtkit-daemon0-21swapper/022:09:110
3293674991614,1cyclictest0-21swapper/321:35:013
329367499161,12cyclictest3321523-21taskset19:30:013
329367499157,5cyclictest3416236-21turbostat20:45:003
329367499155,8cyclictest3690972-21taskset23:40:123
329367499155,8cyclictest3690972-21taskset23:40:123
329367499154,7cyclictest34944722sleep321:35:313
3293674991513,0cyclictest0-21swapper/323:33:593
3293674991513,0cyclictest0-21swapper/321:50:223
3293674991513,0cyclictest0-21swapper/320:54:053
3293674991512,1cyclictest0-21swapper/323:56:473
3293674991512,1cyclictest0-21swapper/323:50:153
3293674991512,1cyclictest0-21swapper/323:13:423
3293674991512,1cyclictest0-21swapper/322:32:053
3293674991512,1cyclictest0-21swapper/322:21:023
3293674991512,1cyclictest0-21swapper/319:13:433
3293674991512,1cyclictest0-21swapper/300:11:173
329367499151,11cyclictest3617219-21turbostat22:55:003
329367499151,11cyclictest3337164-21taskset19:40:193
329367499151,11cyclictest3333924-21turbostat19:40:013
329367499150,6cyclictest0-21swapper/323:35:123
329367499148,4cyclictest3640808-21taskset23:08:393
329367499147,4cyclictest3521251-21taskset21:55:143
329367499145,7cyclictest3503195-21taskset21:41:553
3293674991412,0cyclictest0-21swapper/323:15:503
3293674991412,0cyclictest0-21swapper/319:18:483
3293674991411,1cyclictest0-21swapper/321:15:243
3293674991411,1cyclictest0-21swapper/321:04:143
3293674991411,1cyclictest0-21swapper/319:58:343
3293674991411,1cyclictest0-21swapper/319:47:053
329367499141,10cyclictest3770043-21chrt00:25:323
329367499141,10cyclictest3671993-21taskset23:25:253
329367499141,10cyclictest3657925-21chrt23:20:133
329367499141,10cyclictest3617498-21taskset22:55:123
329367499141,10cyclictest3600759-21taskset22:41:143
329367499141,10cyclictest3529162-21chrt22:00:073
329367499141,10cyclictest3510908-21taskset21:45:563
329367499141,10cyclictest3479301-21chrt21:27:533
329367499141,10cyclictest3396569-21chrt20:25:223
329367499141,10cyclictest3349550-21chrt19:50:173
36739582130,10sleep03673965-21sh23:29:440
329367499134,7cyclictest3559501-21taskset22:16:053
329367499131,9cyclictest3602793-21taskset22:45:143
329367499131,9cyclictest3453967-21taskset21:10:263
329367499131,9cyclictest3434806-21taskset20:55:353
329367499131,9cyclictest3372053-21taskset20:10:123
329367499131,9cyclictest3316973-21taskset19:25:173
3293674991311,1cyclictest0-21swapper/300:05:073
329367499131,10cyclictest3544606-21taskset22:09:043
329367499131,10cyclictest3447666-21taskset21:07:453
329367499131,10cyclictest3380082-21taskset20:15:173
329367499131,10cyclictest3371600-21taskset20:07:323
3293674991311,0cyclictest0-21swapper/322:12:053
3293674991311,0cyclictest0-21swapper/320:01:233
3293674991310,1cyclictest0-21swapper/320:45:173
3293674991310,1cyclictest0-21swapper/320:21:593
329367499130,10cyclictest3753021-21taskset00:15:183
132298130,9rtkit-daemon3551925-21ssh22:12:160
132298130,4rtkit-daemon507-21gmain23:39:570
36890632121,9sleep13689071-21ssh23:36:261
35457492127,3sleep23546342-21irqrtprio22:10:162
34369222124,6sleep13438921-21tr21:00:191
33865492120,5sleep03388638-21tr20:20:200
329367499124,6cyclictest36990472sleep323:45:063
329367499121,8cyclictest3404038-21chrt20:35:163
132298120,4rtkit-daemon3592502-21ssh22:36:300
132298120,2rtkit-daemon171rcu_preempt20:15:181
36031672111,7sleep13602748-21/usr/sbin/munin22:45:171
132298110,6rtkit-daemon3578223-21diskstats22:30:140
132298110,4rtkit-daemon3714788-21ssh23:54:400
132298110,4rtkit-daemon3568656-21ssh22:22:550
132298110,4rtkit-daemon3300075-21munin-node19:32:551
37565332100,2sleep00-21swapper/000:20:170
36767912100,2sleep23678860-21kthreadcore23:30:182
36095322100,4sleep20-21swapper/222:47:472
35719022103,1sleep1171rcu_preempt22:25:181
34227902101,5sleep03422823-21apt-get20:50:170
33912282102,4sleep03391261-21apt-get20:25:120
132298100,7rtkit-daemon507-21gmain23:01:450
132298100,7rtkit-daemon507-21gmain20:06:051
132298100,6rtkit-daemon507-21gmain23:17:491
132298100,6rtkit-daemon3378415-21latency_hist20:15:001
132298100,6rtkit-daemon3339763-21unixbench_multi19:40:251
132298100,5rtkit-daemon3625074-21ssh22:59:510
132298100,4rtkit-daemon507-21gmain20:50:411
132298100,3rtkit-daemon647-21snmpd21:29:101
132298100,3rtkit-daemon647-21snmpd21:21:411
132298100,3rtkit-daemon647-21snmpd21:21:411
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional