You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-29 - 07:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackeslot8s.osadl.org (updated Sat Nov 29, 2025 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
35030649912530,1250cyclictest38916332sleep323:35:013
35030649912320,1228cyclictest37537792sleep322:10:013
35030649911120,1107cyclictest3605627-21sleep20:30:013
3503064992219,1cyclictest0-21swapper/321:45:003
350306499187,8cyclictest3826757-21turbostat22:55:003
350306499177,6cyclictest39219532sleep323:50:533
3503064991714,1cyclictest0-21swapper/321:30:003
3503064991714,1cyclictest0-21swapper/321:15:153
3503064991714,1cyclictest0-21swapper/320:45:003
3503064991613,1cyclictest0-21swapper/323:30:333
3503064991613,1cyclictest0-21swapper/321:55:183
3503064991613,1cyclictest0-21swapper/319:27:593
350306499161,11cyclictest3827130-21taskset22:55:143
350306499161,11cyclictest3801243-21taskset22:37:423
350306499157,5cyclictest3818398-21turbostat22:50:013
350306499154,8cyclictest3875965-21taskset23:25:153
3503064991513,1cyclictest0-21swapper/323:45:183
3503064991513,1cyclictest0-21swapper/323:00:163
3503064991513,1cyclictest0-21swapper/320:45:123
3503064991513,1cyclictest0-21swapper/300:15:083
3503064991512,1cyclictest0-21swapper/320:50:453
3503064991512,1cyclictest0-21swapper/320:05:163
3503064991512,1cyclictest0-21swapper/320:01:413
350306499151,11cyclictest3956006-21turbostat00:15:003
350306499151,11cyclictest3524071-21taskset19:25:013
350306499151,10cyclictest3585802-21taskset20:10:203
350306499149,3cyclictest0-21swapper/321:55:003
350306499144,7cyclictest35431992sleep319:40:123
350306499144,7cyclictest3536304-21taskset19:33:103
3503064991413,0cyclictest0-21swapper/322:29:543
3503064991413,0cyclictest0-21swapper/321:10:243
3503064991413,0cyclictest0-21swapper/319:36:353
3503064991412,1cyclictest0-21swapper/323:20:063
3503064991412,1cyclictest0-21swapper/323:17:053
3503064991412,1cyclictest0-21swapper/323:13:003
3503064991412,1cyclictest0-21swapper/322:40:063
3503064991411,1cyclictest0-21swapper/322:21:363
3503064991411,1cyclictest0-21swapper/300:31:543
350306499141,10cyclictest3979846-21taskset00:29:033
350306499141,10cyclictest3964497-21taskset00:20:133
350306499141,10cyclictest3695547-21taskset21:32:153
350306499141,10cyclictest3672485-21taskset21:20:043
350306499141,10cyclictest3642861-21taskset20:55:243
350306499141,10cyclictest3561241-21taskset19:50:453
350306499141,10cyclictest3508466-21taskset19:10:223
350306499134,7cyclictest3649813-21taskset21:05:023
350306499133,7cyclictest3697011-21taskset21:35:073
350306499133,7cyclictest3697011-21taskset21:35:063
350306499131,9cyclictest3945329-21taskset00:05:193
350306499131,9cyclictest3929871-21taskset23:55:293
350306499131,9cyclictest38432742sleep323:05:123
350306499131,9cyclictest3737668-21taskset22:00:083
350306499131,9cyclictest3592635-21taskset20:15:253
350306499131,9cyclictest3554397-21taskset19:45:203
350306499131,9cyclictest3511675-21taskset19:15:113
3503064991312,0cyclictest0-21swapper/322:30:563
3503064991312,0cyclictest0-21swapper/321:47:013
3503064991311,1cyclictest0-21swapper/322:16:343
3503064991311,1cyclictest0-21swapper/320:30:213
350306499131,10cyclictest3996355-21taskset00:39:573
3503064991310,1cyclictest0-21swapper/300:00:203
350306499130,11cyclictest3906842-21taskset23:43:213
350306499130,10cyclictest3567561-21taskset19:56:383
190898130,4rtkit-daemon3661711-21ntp_states21:10:200
38737172120,3sleep03873725-21ssh23:21:320
350306499129,1cyclictest0-21swapper/320:35:163
3503064991211,0cyclictest0-21swapper/322:05:043
3503064991210,1cyclictest0-21swapper/321:00:503
350306499120,10cyclictest3593264-21taskset20:20:023
35025982120,3sleep30-21swapper/319:05:463
190898120,7rtkit-daemon3843624-21head23:05:150
39697462111,7sleep03969876-21python300:20:230
37462262110,8sleep13747171-21cut22:05:161
35231442111,8sleep13523252-21/usr/sbin/munin19:20:231
190898110,7rtkit-daemon3727697-21ssh21:51:232
190898110,6rtkit-daemon3930844-21ssh23:57:470
190898110,4rtkit-daemon3760328-21ssh22:12:042
190898110,4rtkit-daemon3509442-21munin-node21:37:190
190898110,4rtkit-daemon3509442-21munin-node21:37:190
190898110,4rtkit-daemon1928-21sendmail-mta22:41:232
190898110,3rtkit-daemon1928-21sendmail-mta20:15:040
36498622101,5sleep23650017-21diskstats21:05:142
35449972100,7sleep23547056-21grep19:40:152
35245882100,7sleep03524822-21cut19:25:150
190898100,6rtkit-daemon3509442-21munin-node23:10:060
190898100,6rtkit-daemon1928-21sendmail-mta00:10:182
190898100,5rtkit-daemon3708295-21cut21:40:180
190898100,4rtkit-daemon667-21snmpd19:24:560
190898100,3rtkit-daemon667-21snmpd19:58:390
190898100,3rtkit-daemon667-21snmpd00:34:261
190898100,3rtkit-daemon3509442-21munin-node00:01:521
3922863291,4sleep03922871-21ssh23:53:100
3922547290,6sleep13922554-21sh23:52:191
3914857292,1sleep0171rcu_preempt23:48:130
3826189290,2sleep10-21swapper/122:53:441
3786337290,6sleep13786345-21ssh22:30:041
3775213290,6sleep03775275-21ntp_states22:20:210
3664487291,4sleep03664630-21df21:15:130
3663417291,6sleep13663423-21ssh21:13:221
3631680291,5sleep03632586-21cat20:50:170
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional