You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-24 - 04:13

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackeslot8s.osadl.org (updated Mon Nov 24, 2025 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
40495159912161,1211cyclictest329592sleep321:25:013
40495159912160,1212cyclictest3396692sleep300:34:563
40495159912160,1212cyclictest2752192sleep323:55:013
190898240,8rtkit-daemon235610-21sh23:30:152
4049515992219,1cyclictest0-21swapper/321:55:183
190898200,1rtkit-daemon0-21swapper/119:05:341
190898190,5rtkit-daemon321103-21ntp_states00:20:200
404951599187,7cyclictest267013-21turbostat23:49:593
404951599186,9cyclictest283058-21turbostat00:04:553
404951599186,8cyclictest4139478-21turbostat20:20:003
4049515991714,1cyclictest0-21swapper/323:20:013
4049515991714,1cyclictest0-21swapper/320:55:013
404951599171,13cyclictest24761-21taskset21:20:013
404951599171,11cyclictest251465-21taskset23:40:143
404951599166,7cyclictest341197-21taskset00:35:163
4049515991613,1cyclictest0-21swapper/319:45:003
2024502161,6sleep2202470-21/usr/sbin/munin23:10:012
404951599155,6cyclictest40835922sleep319:35:163
404951599151,9cyclictest2672832sleep323:50:133
4049515991513,1cyclictest0-21swapper/319:15:033
4049515991513,1cyclictest0-21swapper/300:27:033
4049515991513,0cyclictest0-21swapper/321:07:003
4049515991513,0cyclictest0-21swapper/300:10:203
4049515991512,1cyclictest0-21swapper/322:50:183
4049515991512,1cyclictest0-21swapper/321:00:063
4049515991512,1cyclictest0-21swapper/320:55:223
4049515991512,1cyclictest0-21swapper/320:37:313
4049515991512,1cyclictest0-21swapper/319:12:183
404951599151,11cyclictest57147-21chrt21:40:003
404951599151,11cyclictest129654-21turbostat22:25:003
404951599151,11cyclictest105363-21turbostat22:09:593
404951599151,10cyclictest159879-21taskset22:40:223
404951599150,7cyclictest0-21swapper/323:10:143
190898150,10rtkit-daemon4139770-21apt-get20:20:141
190898150,10rtkit-daemon4139770-21apt-get20:20:141
715732140,7sleep171581-21ssh21:46:411
404951599146,5cyclictest1445442sleep322:32:143
404951599145,6cyclictest415962sleep321:30:163
404951599145,6cyclictest3140682sleep300:17:143
404951599141,9cyclictest40957222sleep319:45:143
4049515991412,1cyclictest0-21swapper/321:21:033
4049515991412,1cyclictest0-21swapper/319:23:023
4049515991412,0cyclictest0-21swapper/323:36:303
4049515991412,0cyclictest0-21swapper/323:07:153
4049515991412,0cyclictest0-21swapper/320:21:013
4049515991412,0cyclictest0-21swapper/320:21:013
4049515991411,1cyclictest0-21swapper/323:01:143
4049515991411,1cyclictest0-21swapper/322:19:163
4049515991411,1cyclictest0-21swapper/321:47:553
4049515991411,1cyclictest0-21swapper/319:25:163
404951599141,10cyclictest81064-21turbostat21:54:593
404951599141,10cyclictest4176945-21taskset20:47:143
404951599141,10cyclictest4154644-21taskset20:30:163
404951599141,10cyclictest4114098-21taskset19:57:313
404951599141,10cyclictest4079378-21chrt19:30:173
404951599141,10cyclictest297360-21taskset00:05:273
404951599141,10cyclictest184133-21taskset22:55:303
404951599141,10cyclictest16056-21taskset21:13:323
41082952133,5sleep14108328-21apt-get19:55:141
404951599134,6cyclictest1357362sleep322:25:383
404951599133,7cyclictest148382-21taskset22:35:183
404951599133,7cyclictest148382-21taskset22:35:183
404951599131,9cyclictest49562-21taskset21:35:163
404951599131,9cyclictest4167606-21taskset20:40:183
404951599131,9cyclictest4132715-21taskset20:10:243
404951599131,9cyclictest4120904-21taskset20:05:123
404951599131,9cyclictest4107684-21chrt19:50:263
404951599131,9cyclictest315754-21chrt00:20:013
404951599131,9cyclictest235131-21taskset23:30:043
4049515991312,0cyclictest0-21swapper/322:02:143
4049515991311,1cyclictest0-21swapper/322:46:433
4049515991311,0cyclictest0-21swapper/323:20:123
404951599130,10cyclictest4151808-21chrt20:27:443
818722121,8sleep082871-21/usr/sbin/munin21:55:160
41526852121,2sleep10-21swapper/120:30:151
404951599121,9cyclictest4120307-21taskset20:01:033
4049515991210,1cyclictest0-21swapper/323:26:183
404951599120,9cyclictest105634-21taskset22:10:103
40493822121,7sleep04049394-21munin-run19:10:010
2437102120,4sleep0244709-21irqstats23:35:150
2185102121,8sleep0218535-21munin-run23:20:010
190898120,7rtkit-daemon346494-21ssh00:37:040
190898120,5rtkit-daemon1928-21sendmail-mta23:21:311
1622292121,8sleep2162392-21diskstats22:45:122
190898110,4rtkit-daemon338355-21ssh00:31:540
190898110,3rtkit-daemon4055945-21munin-node23:16:571
142132111,7sleep014270-21/usr/sbin/munin21:10:210
1374522111,7sleep0137460-21ssh22:29:310
493552100,4sleep249559-21hddtemp_smartct21:35:162
3473942100,7sleep2347402-21ssh00:39:092
327022101,5sleep132729-21munin-run21:25:011
3079392100,7sleep1308119-21sed00:15:191
26332101,4sleep12666-21apt-get21:05:131
2042392101,7sleep0206071-21grep23:10:180
190898100,6rtkit-daemon667-21snmpd19:12:091
190898100,5rtkit-daemon324283-21hddtemp_smartct00:25:160
190898100,4rtkit-daemon421-21avahi-daemon23:02:081
190898100,4rtkit-daemon15101-21ssh21:11:151
73358291,4sleep073391-21apt-get21:50:120
4100985290,6sleep14101106-21cat19:45:241
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional