You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-22 - 04:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack3slot3s.osadl.org (updated Sat Nov 22, 2025 00:43:58)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3697840212862,62sleep30-21swapper/319:09:353
369778629262,10sleep20-21swapper/219:08:542
369762328053,19sleep00-21swapper/019:06:480
369770727559,10sleep10-21swapper/119:07:531
40569462530,2sleep14056945-21ssh23:27:031
39847992281,15sleep13984835-21ssh22:45:141
3698165992825,1cyclictest0-21swapper/322:40:003
3698165992824,2cyclictest0-21swapper/322:50:223
3698165992823,2cyclictest0-21swapper/321:10:003
40253002251,2sleep00-21swapper/023:09:190
3698165992522,1cyclictest0-21swapper/300:00:013
3698165992521,2cyclictest0-21swapper/322:10:153
39650792241,2sleep00-21swapper/022:30:540
38841732241,6sleep03827241-21diskmemload21:43:360
38513032240,3sleep00-21swapper/021:24:020
369816599243,6cyclictest3788928-21taskset20:30:193
3698165992421,2cyclictest0-21swapper/323:19:563
369816599239,11cyclictest4083372-21turbostat23:49:563
369816599232,15cyclictest3835225-21taskset21:14:393
369816599232,14cyclictest4006557-21taskset22:55:543
369816599232,14cyclictest3925331-21taskset22:08:113
3698165992319,2cyclictest0-21swapper/323:40:193
3698165992311,8cyclictest4152861-21taskset00:27:223
37960772221,16sleep03797538-21cut20:40:140
369816599222,13cyclictest3890421-21taskset21:45:303
3698165992219,1cyclictest0-21swapper/321:27:213
3698165992218,3cyclictest0-21swapper/300:20:123
369816599212,15cyclictest3769169-21chrt20:15:113
369816599212,14cyclictest4091857-21chrt23:50:103
369816599212,13cyclictest4064390-21taskset23:30:533
3698165992118,1cyclictest0-21swapper/323:21:273
3698165992117,2cyclictest0-21swapper/321:50:173
3698165992116,3cyclictest0-21swapper/323:10:203
3698165992116,2cyclictest0-21swapper/321:43:043
369816599211,16cyclictest4022828-21taskset23:05:323
369816599211,16cyclictest3967851-21turbostat22:35:003
369816599210,18cyclictest66550irq/131-enp1s0-TxRx-300:14:163
369816599210,14cyclictest3916191-21taskset22:01:543
41506492201,13sleep14151132-21head00:25:161
40739222200,9sleep244-21ksoftirqd/223:38:032
39274872201,8sleep23928170-21tr22:10:152
369816599202,12cyclictest3851561-21taskset21:24:253
3698165992015,3cyclictest0-21swapper/323:25:283
369816599201,16cyclictest4075086-21chrt23:39:523
369816599201,14cyclictest0-21swapper/320:25:123
369816599201,14cyclictest0-21swapper/320:25:113
39981362191,7sleep20-21swapper/222:50:562
39342452191,3sleep03827241-21diskmemload22:14:060
38517782191,4sleep23827241-21diskmemload21:24:452
38262122191,1sleep00-21swapper/021:05:190
369816599192,13cyclictest4016016-21taskset23:02:433
369816599191,6cyclictest4139180-21turbostat00:20:003
3698165991916,1cyclictest0-21swapper/322:40:213
369816599191,15cyclictest4167280-21chrt00:36:003
369816599191,14cyclictest3984739-21chrt22:45:073
369816599191,14cyclictest3943108-21chrt22:19:543
369816599191,13cyclictest3860483-21chrt21:30:023
369816599191,13cyclictest3758336-21turbostat20:04:593
369816599190,14cyclictest41550822chrt00:30:153
40426982181,4sleep13827241-21diskmemload23:20:101
39076052181,4sleep03827241-21diskmemload21:56:260
39009132181,8sleep13827241-21diskmemload21:53:511
38903972181,3sleep10-21swapper/121:45:291
38598372181,3sleep20-21swapper/221:29:302
38432332180,8sleep03827241-21diskmemload21:19:190
369816599182,12cyclictest4115843-21taskset00:04:373
369816599182,12cyclictest3909720-21taskset21:59:333
369816599182,11cyclictest4120899-21taskset00:05:253
369816599182,11cyclictest4120899-21taskset00:05:253
369816599182,11cyclictest3943509-21taskset22:20:063
369816599182,11cyclictest3816949-21taskset21:00:133
3698165991815,1cyclictest0-21swapper/321:15:253
3698165991815,1cyclictest0-21swapper/320:45:173
369816599181,12cyclictest3951795-21taskset22:25:113
369816599181,11cyclictest3732032-21taskset19:40:003
369816599181,10cyclictest3742740-21taskset19:50:063
369816599180,15cyclictest0-21swapper/321:35:083
40984862171,3sleep13827241-21diskmemload23:53:131
40762132171,7sleep14076249-21kthreadcore23:40:191
40479362171,4sleep23827241-21diskmemload23:20:592
40149322170,1sleep10-21swapper/123:01:061
39744352177,6sleep03827241-21diskmemload22:37:310
39324982170,1sleep10-21swapper/122:11:311
39236452171,4sleep23827241-21diskmemload22:05:392
39174512170,3sleep20-21swapper/222:03:502
38814082171,11sleep13881458-21ntpq21:40:201
38231452171,12sleep13824853-21cut21:05:161
369816599177,6cyclictest3795027-21taskset20:37:323
3698165991714,1cyclictest0-21swapper/320:40:173
3698165991714,1cyclictest0-21swapper/319:50:003
3698165991714,1cyclictest0-21swapper/319:30:153
3698165991713,2cyclictest0-21swapper/320:55:163
369816599171,12cyclictest0-21swapper/319:25:143
369816599171,11cyclictest3753068-21turbostat20:00:003
3698165991710,3cyclictest0-21swapper/320:50:103
41146942160,3sleep20-21swapper/200:02:532
40911782161,2sleep00-21swapper/023:49:320
40655212161,9sleep23827241-21diskmemload23:32:382
40399852161,2sleep10-21swapper/123:16:291
39838752161,3sleep10-21swapper/122:44:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional