You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-31 - 05:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Fri Jul 31, 2026 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22674992720,6cyclictest4504-21run-parts22:53:393
22674992624,1cyclictest8942-21apt-get23:55:023
2267499260,22cyclictest0-21swapper/322:40:543
2267499260,0cyclictest0-21swapper/323:33:323
2267099260,5cyclictest0-21swapper/223:34:252
22674992523,1cyclictest3942-21sh22:25:003
22674992523,1cyclictest27988-21rm21:20:263
22674992523,1cyclictest0-21swapper/300:39:133
22674992522,3cyclictest0-21swapper/322:00:523
22674992521,3cyclictest15914-21diskmemload00:31:473
22674992521,3cyclictest15914-21diskmemload00:31:473
22674992520,4cyclictest15914-21diskmemload22:10:163
2267499250,24cyclictest0-21swapper/323:00:013
2267499250,24cyclictest0-21swapper/323:00:013
2267499250,24cyclictest0-21swapper/321:40:143
2267499250,20cyclictest2776-21ssh23:49:313
2267499250,1cyclictest0-21swapper/322:07:233
2267499250,1cyclictest0-21swapper/300:21:313
2267099253,21cyclictest15914-21diskmemload23:17:142
22670992520,4cyclictest0-21swapper/200:03:522
2266699250,24cyclictest20169-21apt-get23:08:331
2266699250,24cyclictest0-21swapper/123:11:001
22662992523,1cyclictest0-21swapper/023:22:010
2266299250,24cyclictest22950-21cron23:10:010
2266299250,1cyclictest10082-21ssh23:55:500
22674992423,1cyclictest15914-21diskmemload00:05:203
22674992422,1cyclictest1645-21cron23:20:013
22674992421,3cyclictest15914-21diskmemload21:45:413
22674992421,2cyclictest0-21swapper/300:11:513
2267499240,24cyclictest0-21swapper/322:37:503
2267499240,24cyclictest0-21swapper/300:29:563
2267499240,23cyclictest0-21swapper/323:10:223
2267499240,21cyclictest0-21swapper/322:25:483
2267499240,1cyclictest0-21swapper/323:37:093
2267499240,0cyclictest0-21swapper/322:45:393
22670992422,1cyclictest33302chrt21:55:542
22670992422,1cyclictest0-21swapper/221:11:382
22670992422,0cyclictest0-21swapper/221:30:452
22670992421,0cyclictest0-21swapper/222:50:512
2267099240,24cyclictest0-21swapper/200:05:302
2267099240,23cyclictest4615-21rm00:18:562
2267099240,23cyclictest21454-21apt-get23:38:312
2267099240,23cyclictest15914-21diskmemload23:48:222
2267099240,23cyclictest0-21swapper/223:59:452
2267099240,23cyclictest0-21swapper/221:21:382
2267099240,1cyclictest271rcuc/200:13:432
2267099240,1cyclictest19772-21kworker/u8:122:14:092
22666992424,0cyclictest0-21swapper/122:06:351
22666992423,0cyclictest25556-21apt-get19:18:321
22666992421,2cyclictest25735-21ssh22:15:351
2266699240,24cyclictest0-21swapper/121:56:061
2266699240,23cyclictest0-21swapper/123:55:021
2266699240,0cyclictest15914-21diskmemload22:41:161
2266699240,0cyclictest15914-21diskmemload00:36:331
2266699240,0cyclictest0-21swapper/122:28:351
2266699240,0cyclictest0-21swapper/100:00:581
22662992424,0cyclictest0-21swapper/022:27:300
22662992423,1cyclictest15914-21diskmemload22:55:490
22662992423,0cyclictest26479-21apt-get21:48:310
22662992422,2cyclictest15914-21diskmemload23:25:040
22662992421,2cyclictest3078-21chrt22:53:300
2266299240,23cyclictest7530-21sh21:59:170
2266299240,23cyclictest19031-21ssh00:32:550
2266299240,23cyclictest19031-21ssh00:32:550
2266299240,23cyclictest15914-21diskmemload22:13:220
2266299240,23cyclictest15914-21diskmemload00:17:040
2266299240,23cyclictest15914-21diskmemload00:01:500
2266299240,23cyclictest0-21swapper/022:45:450
2266299240,22cyclictest28356-21rm22:18:330
22674992323,0cyclictest0-21swapper/322:31:033
22674992323,0cyclictest0-21swapper/322:15:243
22674992321,2cyclictest0-21swapper/321:50:063
22674992321,1cyclictest0-21swapper/322:56:103
2267499230,2cyclictest16288-21rm21:10:093
2267499230,22cyclictest7307-21apt-get23:25:023
2267499230,22cyclictest0-21swapper/323:40:503
2267499230,22cyclictest0-21swapper/321:30:443
2267499230,20cyclictest15914-21diskmemload21:56:313
2267499230,0cyclictest0-21swapper/323:22:493
2267499230,0cyclictest0-21swapper/321:27:213
2267499230,0cyclictest0-21swapper/300:01:133
22670992323,0cyclictest15914-21diskmemload23:24:382
22670992323,0cyclictest15914-21diskmemload22:37:132
22670992323,0cyclictest0-21swapper/223:42:342
22670992323,0cyclictest0-21swapper/222:15:582
22670992323,0cyclictest0-21swapper/221:45:072
22670992321,1cyclictest313-21systemd-journal20:50:012
22670992321,1cyclictest0-21swapper/223:53:252
22670992320,3cyclictest0-21swapper/221:19:412
22670992319,4cyclictest0-21swapper/200:31:582
22670992319,4cyclictest0-21swapper/200:31:582
2267099230,2cyclictest9751-21ssh23:27:212
2267099230,2cyclictest6201-21rm21:29:302
2267099230,2cyclictest10599-21rm22:31:052
2267099230,22cyclictest6815-21ssh22:55:542
2267099230,22cyclictest29658-21ssh22:48:242
2267099230,22cyclictest27395-21cron19:20:012
2267099230,22cyclictest0-21swapper/221:50:192
2267099230,22cyclictest0-21swapper/221:35:152
2267099230,1cyclictest0-21swapper/200:20:292
2267099230,0cyclictest15914-21diskmemload22:27:382
22666992323,0cyclictest15914-21diskmemload21:20:131
22666992323,0cyclictest0-21swapper/123:52:001
22666992323,0cyclictest0-21swapper/123:35:211
22666992323,0cyclictest0-21swapper/123:20:171
22666992323,0cyclictest0-21swapper/122:56:541
22666992323,0cyclictest0-21swapper/121:53:311
22666992322,1cyclictest0-21swapper/123:17:081
22666992321,1cyclictest729-21apt-get19:33:331
22666992321,1cyclictest0-21swapper/122:35:331
22666992321,1cyclictest0-21swapper/121:31:211
22666992321,1cyclictest0-21swapper/119:23:301
22666992321,1cyclictest0-21swapper/100:15:201
22666992320,2cyclictest5030-21sendmail19:40:001
2266699230,23cyclictest13273-21ssh23:01:531
2266699230,23cyclictest13273-21ssh23:01:531
2266699230,23cyclictest0-21swapper/122:50:041
2266699230,23cyclictest0-21swapper/122:48:561
2266699230,23cyclictest0-21swapper/121:46:001
2266699230,23cyclictest0-21swapper/121:41:001
2266699230,23cyclictest0-21swapper/121:37:161
2266699230,22cyclictest25035-21latency_hist19:15:011
2266699230,22cyclictest24827-21apt-get20:23:311
2266699230,22cyclictest0-21swapper/123:44:051
2266699230,22cyclictest0-21swapper/123:25:001
2266699230,22cyclictest0-21swapper/122:22:391
2266699230,22cyclictest0-21swapper/121:15:221
2266699230,1cyclictest15946-21awk21:10:001
2266699230,0cyclictest0-21swapper/122:12:121
2266699230,0cyclictest0-21swapper/121:26:311
2266699230,0cyclictest0-21swapper/100:30:321
2266699230,0cyclictest0-21swapper/100:30:321
22662992323,0cyclictest15914-21diskmemload23:40:580
22662992323,0cyclictest0-21swapper/022:08:450
22662992323,0cyclictest0-21swapper/021:16:130
22662992321,1cyclictest62550irq/127-eno100:10:570
22662992321,1cyclictest0-21swapper/023:51:200
22662992321,1cyclictest0-21swapper/022:38:310
2266299231,1cyclictest62550irq/127-eno123:32:500
2266299230,23cyclictest15914-21diskmemload23:15:150
2266299230,23cyclictest15914-21diskmemload21:38:010
2266299230,23cyclictest0-21swapper/023:48:190
2266299230,22cyclictest31413-21ssh21:52:370
2266299230,22cyclictest3015-21sh22:23:420
2266299230,22cyclictest26656-21ssh00:38:410
2266299230,22cyclictest23670-21ssh23:10:440
2266299230,22cyclictest18481-21sh21:40:250
2266299230,22cyclictest0-21swapper/023:37:280
2266299230,0cyclictest15914-21diskmemload22:31:000
2266299230,0cyclictest0-21swapper/021:22:370
2266299230,0cyclictest0-21swapper/021:12:220
2266299230,0cyclictest0-21swapper/000:23:540
22674992222,0cyclictest0-21swapper/323:52:113
22674992222,0cyclictest0-21swapper/319:38:313
2267499220,21cyclictest22281-21sh21:15:203
2267499220,21cyclictest0-21swapper/323:06:123
2267499220,21cyclictest0-21swapper/321:03:323
2267499220,21cyclictest0-21swapper/320:33:303
2267499220,21cyclictest0-21swapper/300:15:243
22670992222,0cyclictest0-21swapper/222:00:242
22670992220,1cyclictest0-21swapper/221:40:342
22670992219,2cyclictest28-21ksoftirqd/220:05:012
2267099220,21cyclictest21888-21munin-run20:15:002
2267099220,21cyclictest0-21swapper/223:05:192
2267099220,21cyclictest0-21swapper/222:05:152
2267099220,21cyclictest0-21swapper/219:48:302
2267099220,21cyclictest0-21swapper/200:35:442
2267099220,1cyclictest31289-21ssh22:20:262
2267099220,1cyclictest22953-21ssh22:42:202
2267099220,1cyclictest12068-21ssh23:00:152
2267099220,1cyclictest12068-21ssh23:00:152
2267099220,1cyclictest0-21swapper/200:25:202
22666992222,0cyclictest15914-21diskmemload00:21:101
22666992222,0cyclictest0-21swapper/100:25:331
22666992221,1cyclictest0-21swapper/121:10:271
22666992220,1cyclictest0-21swapper/122:00:461
2266699220,21cyclictest28659-21ssh00:12:351
2266699220,21cyclictest25892-21ssh00:09:111
2266699220,21cyclictest0-21swapper/123:31:181
2266699220,21cyclictest0-21swapper/120:38:311
2266699220,21cyclictest0-21swapper/119:58:311
2266699220,1cyclictest3884-21perf20:45:011
2266699220,0cyclictest0-21swapper/122:31:401
22662992221,1cyclictest0-21swapper/000:26:300
22662992221,0cyclictest29619-21apt-get20:33:300
22662992220,2cyclictest10278-21ssh22:02:370
22662992220,1cyclictest0-21swapper/019:23:300
22662992219,2cyclictest26687-21basename20:25:000
22662992219,2cyclictest1401-21ssh21:25:140
2266299220,21cyclictest29076-21cron20:30:000
2266299220,1cyclictest11908-21ssh23:00:030
2266299220,1cyclictest11908-21ssh23:00:030
22674992120,1cyclictest9259-21apt-get20:58:323
22674992120,1cyclictest27220-21apt-get20:28:313
22674992119,1cyclictest30760-21apt-get19:28:313
22674992116,4cyclictest17607-21apt-get20:08:303
2267499210,20cyclictest0-21swapper/320:53:303
22670992119,1cyclictest2635-21cut19:35:002
22670992118,2cyclictest313-21systemd-journal20:40:012
2267099210,20cyclictest0-21swapper/220:28:312
2267099210,0cyclictest0-21swapper/219:28:302
2267099210,0cyclictest0-21swapper/219:13:302
22666992121,0cyclictest30760-21apt-get19:28:301
22666992119,1cyclictest31489-21turbostat.cron20:35:001
22666992118,2cyclictest19493-21munin-run20:10:011
2266699210,21cyclictest0-21swapper/120:28:311
2266699210,20cyclictest0-21swapper/119:50:001
2266699210,1cyclictest0-21swapper/119:43:301
22662992119,1cyclictest32620-21sh19:30:000
22662992119,1cyclictest24291-21dump-pmu-power20:20:000
2266299210,20cyclictest2018-21apt-get20:43:300
2266299210,0cyclictest0-21swapper/020:38:300
2266299210,0cyclictest0-21swapper/019:13:300
22674992020,0cyclictest10403-21apt-get19:53:293
22674992020,0cyclictest0-21swapper/319:20:023
2267499200,0cyclictest0-21swapper/321:08:293
2267499200,0cyclictest0-21swapper/320:48:303
22670992020,0cyclictest0-21swapper/219:43:302
22670992018,1cyclictest8735-21latency_hist20:55:012
22670992018,1cyclictest28366-21apt-get19:23:302
2266699200,0cyclictest6809-21apt-get20:53:301
22662992020,0cyclictest0-21swapper/021:08:290
2266299200,20cyclictest0-21swapper/019:33:330
22674991919,0cyclictest0-21swapper/320:38:313
22674991919,0cyclictest0-21swapper/320:23:313
22674991919,0cyclictest0-21swapper/319:48:303
22674991916,3cyclictest20005-21apt-get20:13:303
22670991919,0cyclictest0-21swapper/219:58:312
22670991917,1cyclictest19479-21perf20:10:012
22662991919,0cyclictest0-21swapper/020:48:300
22674991818,0cyclictest0-21swapper/320:03:313
22674991818,0cyclictest0-21swapper/319:18:323
22674991816,1cyclictest12798-21apt-get19:58:313
22674991815,2cyclictest2211-21grep20:43:303
22670991818,0cyclictest31492-21perf20:35:002
22670991817,0cyclictest0-21swapper/220:58:322
22666991818,0cyclictest0-21swapper/120:13:301
22662991818,0cyclictest0-21swapper/020:13:310
22662991818,0cyclictest0-21swapper/019:53:300
22662991818,0cyclictest0-21swapper/019:38:300
22674991717,0cyclictest0-21swapper/319:33:333
22674991716,1cyclictest23158-21apt-get19:13:293
22670991717,0cyclictest0-21swapper/221:08:292
22670991717,0cyclictest0-21swapper/220:18:292
22666991717,0cyclictest0-21swapper/121:03:321
22666991717,0cyclictest0-21swapper/120:18:301
22666991716,1cyclictest4411-21apt-get20:48:301
2266299170,12cyclictest793-21lldpd19:41:270
2266299170,10cyclictest609-21rs:main0
2267499160,1cyclictest0-21swapper/320:20:003
2267499160,15cyclictest0-21swapper/319:45:003
22670991616,0cyclictest3142-21apt-get19:38:312
22670991616,0cyclictest0-21swapper/220:43:302
22662991616,0cyclictest0-21swapper/019:18:320
2266299160,15cyclictest0-21swapper/020:10:010
22666991515,0cyclictest0-21swapper/120:03:311
22670991414,0cyclictest0-21swapper/221:03:062
2267099140,14cyclictest0-21swapper/220:20:552
2267099140,0cyclictest0-21swapper/219:50:242
2266699140,0cyclictest0-21swapper/120:55:031
2266699140,0cyclictest0-21swapper/119:50:231
22662991414,0cyclictest0-21swapper/019:45:210
2266299140,14cyclictest0-21swapper/020:51:380
2266299140,0cyclictest0-21swapper/021:00:280
2266299140,0cyclictest0-21swapper/020:55:180
2266299140,0cyclictest0-21swapper/020:00:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional