You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-24 - 09:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Thu Sep 24, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
11920992624,1cyclictest19072-21cron19:25:000
1192099260,1cyclictest15626-21sh21:46:490
11927992523,1cyclictest25537-21ssh23:20:583
11927992523,1cyclictest0-21swapper/323:48:593
11927992523,1cyclictest0-21swapper/322:25:003
11927992523,1cyclictest0-21swapper/321:10:503
1192799250,24cyclictest0-21swapper/321:31:243
1192399250,4cyclictest26943-21sh23:50:412
1192399250,24cyclictest0-21swapper/221:38:362
1192399250,24cyclictest0-21swapper/221:16:202
1192399250,21cyclictest0-21swapper/200:02:322
11921992523,1cyclictest437-21sh00:23:271
1192199250,24cyclictest5966-21diskmemload21:23:471
1192199250,24cyclictest13956-21ssh21:16:481
1192099250,24cyclictest5966-21diskmemload22:05:180
11927992421,2cyclictest1-21systemd23:00:003
1192799240,24cyclictest0-21swapper/323:44:383
1192799240,23cyclictest27408-21sh22:53:423
1192799240,23cyclictest21837-21ssh00:14:103
1192799240,23cyclictest0-21swapper/323:08:043
1192799240,23cyclictest0-21swapper/322:40:413
11923992423,1cyclictest0-21swapper/221:57:072
1192399240,23cyclictest5966-21diskmemload21:46:382
1192399240,23cyclictest11401-21appstreamcli00:05:012
1192399240,23cyclictest0-21swapper/221:20:272
1192399240,23cyclictest0-21swapper/221:10:362
1192399240,1cyclictest2326-21perf21:35:002
1192399240,1cyclictest0-21swapper/221:52:532
1192199240,24cyclictest0-21swapper/121:42:501
1192199240,24cyclictest0-21swapper/100:15:401
1192199240,23cyclictest23849-21sh23:18:541
1192199240,23cyclictest0-21swapper/122:55:401
11920992423,1cyclictest0-21swapper/022:58:080
1192099240,23cyclictest20177-21ssh21:22:360
1192099240,23cyclictest0-21swapper/022:19:450
1192099240,23cyclictest0-21swapper/021:40:510
1192099240,1cyclictest0-21swapper/022:11:530
1192099240,0cyclictest5966-21diskmemload00:09:020
11927992323,0cyclictest5966-21diskmemload23:36:083
11927992322,1cyclictest5966-21diskmemload22:02:313
11927992322,1cyclictest5966-21diskmemload21:38:303
11927992322,1cyclictest11620-21apt-get20:18:033
11927992320,2cyclictest10480-21ssh00:04:343
1192799231,1cyclictest5650-21apt22:35:003
1192799230,2cyclictest18077-21sh22:46:133
1192799230,23cyclictest0-21swapper/321:49:143
1192799230,23cyclictest0-21swapper/300:26:373
1192799230,22cyclictest25834-21ssh21:55:223
1192799230,22cyclictest21674-21cstates23:18:093
1192799230,22cyclictest12676-21rm21:15:173
1192799230,22cyclictest0-21swapper/321:24:273
1192799230,0cyclictest0-21swapper/323:30:563
1192799230,0cyclictest0-21swapper/323:11:143
11923992323,0cyclictest5966-21diskmemload22:59:362
11923992323,0cyclictest0-21swapper/200:11:332
11923992321,1cyclictest0-21swapper/222:38:012
1192399230,2cyclictest24335-21sh21:25:362
1192399230,23cyclictest5966-21diskmemload23:57:052
1192399230,23cyclictest0-21swapper/222:23:152
1192399230,23cyclictest0-21swapper/222:13:442
1192399230,23cyclictest0-21swapper/200:26:022
1192399230,22cyclictest7606-21rm23:04:542
1192399230,22cyclictest329-21sh00:23:182
1192399230,22cyclictest20065-21ssh23:16:172
1192399230,22cyclictest16586-21sh23:42:052
1192399230,22cyclictest11133-21idleruntime-cro20:15:002
1192399230,0cyclictest0-21swapper/223:20:432
1192399230,0cyclictest0-21swapper/200:33:182
11921992323,0cyclictest0-21swapper/123:37:171
11921992323,0cyclictest0-21swapper/122:23:451
11921992323,0cyclictest0-21swapper/122:00:271
11921992323,0cyclictest0-21swapper/121:12:501
11921992323,0cyclictest0-21swapper/100:05:171
11921992322,1cyclictest5923-21ssh22:35:051
11921992321,1cyclictest26422-21ssh21:56:161
11921992321,1cyclictest22715-21sh22:50:011
11921992321,1cyclictest0-21swapper/123:49:161
11921992321,1cyclictest0-21swapper/123:25:051
11921992321,1cyclictest0-21swapper/123:14:191
11921992320,2cyclictest2796-21rm23:00:431
11921992319,3cyclictest11133-21awk20:15:001
1192199230,23cyclictest0-21swapper/123:40:211
1192199230,23cyclictest0-21swapper/122:53:071
1192199230,23cyclictest0-21swapper/122:19:161
1192199230,23cyclictest0-21swapper/100:00:211
1192199230,22cyclictest20502-21ssh21:50:561
1192199230,22cyclictest14770-21ssh21:45:461
1192199230,22cyclictest11964-21ssh00:33:451
1192199230,22cyclictest0-21swapper/119:18:021
1192199230,1cyclictest2912-21ssh00:26:191
1192199230,0cyclictest0-21swapper/123:51:241
1192199230,0cyclictest0-21swapper/122:11:541
11920992323,0cyclictest28977-21ssh00:20:220
11920992322,1cyclictest0-21swapper/022:51:430
11920992322,1cyclictest0-21swapper/022:43:130
11920992321,1cyclictest0-21swapper/023:21:080
11920992321,1cyclictest0-21swapper/021:27:460
11920992321,1cyclictest0-21swapper/021:14:210
1192099231,1cyclictest62550irq/127-eno123:05:480
1192099230,23cyclictest0-21swapper/023:02:060
1192099230,23cyclictest0-21swapper/000:37:560
1192099230,23cyclictest0-21swapper/000:16:090
1192099230,22cyclictest783-21snmpd21:51:270
1192099230,22cyclictest32531-21sh23:27:500
1192099230,22cyclictest31475-21sh21:32:580
1192099230,22cyclictest23603-21munin-run20:40:000
1192099230,22cyclictest18852-21cat23:43:140
1192099230,22cyclictest14397-21ssh23:11:130
1192099230,22cyclictest0-21swapper/023:33:120
1192099230,21cyclictest0-21swapper/022:35:160
1192099230,0cyclictest0-21swapper/021:19:450
1192099230,0cyclictest0-21swapper/000:01:070
11927992222,0cyclictest0-21swapper/323:29:423
11927992222,0cyclictest0-21swapper/322:07:213
11927992221,1cyclictest0-21swapper/321:25:213
11927992220,1cyclictest20279-21sh22:18:493
11927992220,1cyclictest15962-21awk20:25:013
11927992220,1cyclictest15962-21awk20:25:013
11927992220,1cyclictest0-21swapper/319:38:063
11927992220,1cyclictest0-21swapper/300:32:483
1192799220,21cyclictest32042-21apt-get19:53:063
1192799220,21cyclictest28062-21kworker/u8:100:05:293
1192799220,21cyclictest0-21swapper/323:51:463
1192799220,21cyclictest0-21swapper/322:35:033
1192799220,21cyclictest0-21swapper/321:50:573
1192799220,21cyclictest0-21swapper/320:28:043
1192799220,1cyclictest412-21ssh00:23:243
1192799220,1cyclictest4078-21apt-get21:08:013
1192799220,1cyclictest3975-21sh23:58:413
1192799220,1cyclictest18024-21ssh00:39:183
1192799220,1cyclictest0-21swapper/323:00:353
1192799220,0cyclictest0-21swapper/321:42:253
11923992222,0cyclictest0-21swapper/222:17:012
11923992221,1cyclictest0-21swapper/223:05:412
11923992220,1cyclictest2144-21phc2sys-jitter22:03:092
11923992220,1cyclictest15954-21turbostat20:25:012
11923992220,1cyclictest15954-21turbostat20:25:012
11923992220,1cyclictest0-21swapper/222:48:292
11923992220,1cyclictest0-21swapper/222:07:062
1192399220,22cyclictest0-21swapper/223:25:082
1192399220,22cyclictest0-21swapper/222:31:302
1192399220,21cyclictest5966-21diskmemload23:45:402
1192399220,21cyclictest5966-21diskmemload22:26:082
1192399220,21cyclictest26013-21munin-run20:45:002
1192399220,21cyclictest23284-21ssh22:50:252
1192399220,21cyclictest13896-21ssh00:36:002
1192399220,21cyclictest10204-1kworker/u9:022:40:492
1192399220,21cyclictest0-21swapper/223:35:222
1192399220,21cyclictest0-21swapper/221:43:002
1192399220,1cyclictest0-21swapper/223:13:352
1192399220,1cyclictest0-21swapper/200:17:332
11921992222,0cyclictest5966-21diskmemload23:07:201
11921992222,0cyclictest0-21swapper/122:27:591
11921992221,1cyclictest0-21swapper/100:35:021
11921992220,1cyclictest0-21swapper/122:05:061
1192199220,21cyclictest0-21swapper/123:55:111
1192199220,21cyclictest0-21swapper/123:32:221
1192199220,21cyclictest0-21swapper/122:41:061
1192199220,21cyclictest0-21swapper/120:53:021
1192199220,21cyclictest0-21swapper/119:40:011
1192199220,1cyclictest0-21swapper/122:32:031
1192199220,0cyclictest0-21swapper/100:12:461
11920992222,0cyclictest5966-21diskmemload23:35:040
11920992222,0cyclictest0-21swapper/000:29:120
11920992222,0cyclictest0-21swapper/000:11:040
1192099220,21cyclictest5966-21diskmemload22:26:470
1192099220,21cyclictest22311-21sh22:21:050
1192099220,21cyclictest0-21swapper/022:00:270
1192099220,21cyclictest0-21swapper/020:33:030
1192099220,21cyclictest0-21swapper/000:31:590
1192099220,0cyclictest0-21swapper/021:58:210
11927992121,0cyclictest0-21swapper/322:11:053
11927992121,0cyclictest0-21swapper/320:33:033
11927992119,1cyclictest31285-21apt-get20:58:053
1192799210,20cyclictest5966-21diskmemload22:25:023
1192799210,1cyclictest9230-21apt-get20:13:073
1192799210,0cyclictest0-21swapper/320:08:053
11923992121,0cyclictest0-21swapper/223:32:322
11923992120,1cyclictest1681-21apt-get21:03:042
11923992119,1cyclictest21500-21munin-run19:30:002
11923992119,1cyclictest0-21swapper/219:50:012
11921992121,0cyclictest0-21swapper/121:36:061
11921992121,0cyclictest0-21swapper/120:33:041
11921992121,0cyclictest0-21swapper/119:48:051
1192199210,2cyclictest25091-21taskset21:26:471
1192199210,20cyclictest12382-21apt-get19:13:021
1192199210,0cyclictest24990-21ssh23:20:081
1192199210,0cyclictest0-21swapper/121:30:251
11920992121,0cyclictest0-21swapper/023:53:020
11920992121,0cyclictest0-21swapper/023:16:360
11920992121,0cyclictest0-21swapper/021:35:510
11920992120,1cyclictest62550irq/127-eno123:47:000
11920992120,1cyclictest5966-21diskmemload23:55:250
11920992120,0cyclictest0-21swapper/019:18:020
1192099210,21cyclictest0-21swapper/020:23:050
1192099210,21cyclictest0-21swapper/020:23:050
1192099210,20cyclictest0-21swapper/020:58:050
1192099210,0cyclictest4439-21apt-get20:03:040
1192099210,0cyclictest0-21swapper/022:45:390
11927992020,0cyclictest0-21swapper/320:48:033
11927992020,0cyclictest0-21swapper/319:40:023
11927992020,0cyclictest0-21swapper/319:28:033
11927992020,0cyclictest0-21swapper/319:18:033
1192799200,20cyclictest19101-21perf19:25:003
1192799200,20cyclictest0-21swapper/319:48:053
11923992020,0cyclictest18836-21apt-get20:33:032
11923992020,0cyclictest0-21swapper/220:28:032
11923992020,0cyclictest0-21swapper/220:08:042
1192399200,0cyclictest2022-21apt-get19:58:042
1192399200,0cyclictest0-21swapper/219:38:062
11921992020,0cyclictest16439-21apt-get20:28:031
11921992018,1cyclictest8727-21idleruntime-cro20:10:001
11921992018,1cyclictest13571-21awk20:20:001
1192199200,19cyclictest0-21swapper/120:35:021
1192199200,0cyclictest0-21swapper/121:08:011
11920992020,0cyclictest0-21swapper/020:53:020
11920992020,0cyclictest0-21swapper/020:18:030
11920992020,0cyclictest0-21swapper/019:28:040
11920992020,0cyclictest0-21swapper/019:13:030
1192099200,0cyclictest26340-21apt-get19:40:020
1192099200,0cyclictest0-21swapper/020:28:030
11927991919,0cyclictest0-21swapper/319:58:043
11927991918,0cyclictest0-21swapper/320:43:023
11923991919,0cyclictest0-21swapper/219:13:022
11923991918,0cyclictest27243-21apt-get19:43:042
11921991919,0cyclictest19586-21apt-get19:28:031
11921991919,0cyclictest0-21swapper/120:43:021
11921991919,0cyclictest0-21swapper/120:03:041
11921991919,0cyclictest0-21swapper/119:43:041
11921991918,1cyclictest26490-21apt-get20:48:031
11921991918,1cyclictest0-21swapper/119:23:041
11920991919,0cyclictest0-21swapper/021:03:050
11920991919,0cyclictest0-21swapper/020:08:040
11920991919,0cyclictest0-21swapper/019:48:050
11920991919,0cyclictest0-21swapper/019:33:030
11920991918,0cyclictest0-21swapper/020:48:030
11923991818,0cyclictest0-21swapper/219:53:062
11921991818,0cyclictest0-21swapper/120:58:051
11921991818,0cyclictest0-21swapper/119:33:031
11920991818,0cyclictest24095-21apt-get20:43:010
11927991717,0cyclictest0-21swapper/320:03:043
11923991717,0cyclictest0-21swapper/220:35:022
11923991717,0cyclictest0-21swapper/219:18:022
11921991717,0cyclictest0-21swapper/121:00:021
11921991714,2cyclictest3903-21cron20:00:001
1192199170,16cyclictest0-21swapper/119:53:061
1192799160,15cyclictest23194-21ls19:33:103
11923991616,0cyclictest0-21swapper/221:08:012
11923991616,0cyclictest0-21swapper/220:48:032
11920991616,0cyclictest0-21swapper/019:53:060
11920991616,0cyclictest0-21swapper/019:38:050
11927991513,1cyclictest0-21swapper/320:40:003
1192799150,1cyclictest0-21swapper/321:00:043
11923991513,1cyclictest0-21swapper/219:21:592
1192399150,14cyclictest4290-21sshd20:01:342
11920991515,0cyclictest0-21swapper/020:13:070
1192799140,14cyclictest0-21swapper/320:50:173
1192799140,14cyclictest0-21swapper/319:11:223
1192399140,14cyclictest0-21swapper/220:50:162
1192399140,0cyclictest0-21swapper/220:15:322
1192399140,0cyclictest0-21swapper/219:32:192
1192099140,14cyclictest0-21swapper/021:05:370
1192099140,0cyclictest0-21swapper/019:57:500
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional