You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-25 - 00:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackeslot8s.osadl.org (updated Mon Nov 24, 2025 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
35874869912420,1237cyclictest4057710-21sleep12:25:003
35874869912380,1234cyclictest39283472sleep311:05:013
35874869912360,1232cyclictest39927792sleep311:44:563
35874869911321,1127cyclictest37418022sleep309:09:573
35874869911011,1095cyclictest3806714-21sleep09:50:013
3587486993372,331cyclictest3863547-21turbostat10:29:563
3587486992017,1cyclictest0-21swapper/308:54:593
3587486991916,1cyclictest0-21swapper/310:05:183
3587486991815,1cyclictest0-21swapper/311:40:003
3587486991815,1cyclictest0-21swapper/308:25:153
358748699177,7cyclictest3757904-21turbostat09:20:003
3587486991714,1cyclictest0-21swapper/312:35:003
3587486991714,1cyclictest0-21swapper/312:10:163
3587486991714,1cyclictest0-21swapper/307:40:013
358748699171,12cyclictest3831227-21turbostat10:05:013
358748699167,6cyclictest3729230-21turbostat09:00:003
358748699167,5cyclictest4081906-21turbostat12:40:003
3587486991613,1cyclictest0-21swapper/312:01:493
3587486991613,1cyclictest0-21swapper/312:01:483
358748699161,11cyclictest3944302-21turbostat11:14:593
36537142157,2sleep1171rcu_preempt08:00:151
358748699155,8cyclictest3627418-21turbostat07:44:553
3587486991513,1cyclictest0-21swapper/307:29:073
3587486991513,1cyclictest0-21swapper/307:29:063
3587486991512,1cyclictest0-21swapper/310:59:043
3587486991512,1cyclictest0-21swapper/310:40:253
3587486991512,1cyclictest0-21swapper/310:35:153
3587486991512,1cyclictest0-21swapper/308:08:573
358748699151,11cyclictest4031435-21taskset12:05:233
358748699151,11cyclictest3863544-21turbostat10:25:003
358748699151,10cyclictest3734949-21taskset09:00:263
35817432151,11sleep23581873-21ps07:05:152
358748699145,6cyclictest40644052sleep312:26:563
3587486991413,0cyclictest0-21swapper/308:30:073
3587486991413,0cyclictest0-21swapper/307:21:423
3587486991412,1cyclictest0-21swapper/311:17:013
3587486991412,1cyclictest0-21swapper/310:54:013
3587486991412,1cyclictest0-21swapper/308:43:073
3587486991412,1cyclictest0-21swapper/308:36:203
3587486991412,1cyclictest0-21swapper/308:01:153
3587486991412,0cyclictest0-21swapper/310:10:153
358748699141,11cyclictest3855547-21taskset10:20:013
3587486991411,1cyclictest0-21swapper/311:00:123
3587486991411,1cyclictest0-21swapper/308:18:193
3587486991411,1cyclictest0-21swapper/307:15:143
358748699141,10cyclictest4009449-21taskset11:55:023
358748699141,10cyclictest4002941-21taskset11:50:173
358748699141,10cyclictest3782319-21chrt09:35:003
358748699141,10cyclictest3766533-21taskset09:25:143
358748699141,10cyclictest3764254-21taskset09:20:593
358748699140,11cyclictest3639159-21chrt07:45:173
39434722131,3sleep13943480-21ssh11:13:061
358748699133,8cyclictest36470212sleep307:55:123
358748699131,9cyclictest3960680-21taskset11:25:003
358748699131,9cyclictest3901409-21taskset10:45:213
358748699131,9cyclictest3788118-21taskset09:35:253
358748699131,9cyclictest3747755-21chrt09:10:243
358748699131,9cyclictest3615303-21taskset07:30:153
358748699131,9cyclictest3592797-21taskset07:10:193
3587486991312,0cyclictest0-21swapper/311:21:353
3587486991311,1cyclictest0-21swapper/307:51:343
3587486991311,0cyclictest0-21swapper/312:19:053
3587486991310,1cyclictest0-21swapper/311:30:213
3587486991310,1cyclictest0-21swapper/309:55:473
358748699130,11cyclictest4000821-21taskset11:49:573
358748699130,11cyclictest4000821-21taskset11:49:563
190898130,8rtkit-daemon3863849-21/usr/sbin/munin10:25:222
38719122121,8sleep03871945-21/usr/sbin/munin10:30:130
37038122121,8sleep03703908-21fschecks_time08:40:170
358748699129,1cyclictest0-21swapper/309:40:243
358748699122,8cyclictest3879405-21chrt10:34:193
358748699121,9cyclictest3814531-21taskset09:53:523
358748699121,9cyclictest3684167-21taskset08:21:073
358748699120,9cyclictest3710159-21chrt08:45:113
358748699120,10cyclictest3671559-21taskset08:10:423
35814312121,6sleep03581586-21diskstats07:05:140
190898120,4rtkit-daemon667-21snmpd09:12:182
190898120,4rtkit-daemon3967405-21ssh11:27:270
190898120,1rtkit-daemon0-21swapper/209:03:402
40067332110,1sleep04006864-21python311:50:230
35813952111,6sleep30-21swapper/307:05:123
190898110,7rtkit-daemon667-21snmpd09:48:070
190898110,7rtkit-daemon3950853-21ssh11:16:260
190898110,4rtkit-daemon3813797-21ssh09:52:100
190898110,10rtkit-daemon1907-21rtkit-daemon09:25:180
40580082101,7sleep04058078-21/usr/sbin/munin12:25:130
40397862100,7sleep24039792-21ssh12:11:042
39611982100,3sleep23961785-21ps11:25:162
38608732101,7sleep13860996-21/usr/sbin/munin10:20:191
38470412100,7sleep13847049-21ssh10:14:141
37415422106,2sleep00-21swapper/009:06:370
35939642100,7sleep03594093-21wc07:15:020
190898100,7rtkit-daemon3593847-21munin-node12:30:132
190898100,5rtkit-daemon3952918-21diskstats11:20:140
190898100,5rtkit-daemon3910611-21ssh10:51:590
190898100,5rtkit-daemon3885491-21switchtime10:35:230
190898100,5rtkit-daemon3628067-21hddtemp_smartct07:40:142
190898100,5rtkit-daemon3614472-21apt-get07:26:522
190898100,5rtkit-daemon3614472-21apt-get07:26:512
190898100,4rtkit-daemon3798042-21ssh09:44:190
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional