You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-08 - 07:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5s.osadl.org (updated Mon Jun 08, 2026 00:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25046992724,2cyclictest5317-21grep22:59:181
25045992721,5cyclictest18712-21diskmemload21:19:140
2504599270,1cyclictest0-21swapper/022:39:210
2504599261,1cyclictest20418-21cpuspeed_turbos22:44:100
2504599260,25cyclictest5845-21sh00:02:020
2504799251,0cyclictest0-21swapper/221:18:552
25046992523,1cyclictest25980-21apt-get00:20:031
25046992523,1cyclictest0-21swapper/123:11:221
2504699250,24cyclictest14133-21ssh22:37:501
2504599250,24cyclictest24439-21sh23:18:580
2504599250,21cyclictest9046-21sh22:33:040
2504599250,1cyclictest29207-21munin-run21:50:000
2504599250,1cyclictest0-21swapper/022:22:370
2504599250,0cyclictest0-21swapper/022:15:520
25048992422,1cyclictest0-21swapper/321:25:013
25048992420,3cyclictest4472-21ssh22:29:103
2504899240,24cyclictest0-21swapper/321:43:193
2504899240,23cyclictest19181-21sh22:42:313
2504899240,23cyclictest18712-21diskmemload23:32:153
2504899240,23cyclictest18712-21diskmemload22:46:073
2504899240,23cyclictest18712-21diskmemload22:21:583
2504799243,20cyclictest18712-21diskmemload00:07:022
25047992420,0cyclictest0-21swapper/200:32:132
2504799240,23cyclictest24162-21ssh22:16:312
2504799240,23cyclictest18712-21diskmemload23:19:522
2504799240,23cyclictest18712-21diskmemload23:07:082
2504799240,23cyclictest0-21swapper/222:06:012
2504799240,23cyclictest0-21swapper/221:28:052
25046992424,0cyclictest0-21swapper/122:20:151
25046992424,0cyclictest0-21swapper/122:04:591
25046992423,1cyclictest7934-21ssh22:31:221
25046992422,1cyclictest5488-21sh00:01:321
25046992421,2cyclictest24890-21sh21:16:151
2504699240,24cyclictest0-21swapper/123:04:131
2504699240,24cyclictest0-21swapper/122:50:311
2504699240,24cyclictest0-21swapper/122:18:031
2504699240,24cyclictest0-21swapper/121:26:011
2504699240,23cyclictest75-21kswapd023:39:101
2504699240,23cyclictest18712-21diskmemload21:12:561
2504699240,23cyclictest0-21swapper/123:40:021
2504699240,23cyclictest0-21swapper/121:37:101
2504699240,0cyclictest0-21swapper/123:59:011
2504699240,0cyclictest0-21swapper/122:09:121
2504699240,0cyclictest0-21swapper/120:59:091
25045992422,2cyclictest0-21swapper/023:48:350
25045992422,2cyclictest0-21swapper/000:11:370
25045992422,1cyclictest18712-21diskmemload00:24:040
2504599240,24cyclictest0-21swapper/023:55:190
2504599240,24cyclictest0-21swapper/022:49:080
2504599240,24cyclictest0-21swapper/021:30:540
2504599240,23cyclictest3471-21ssh00:29:220
2504599240,23cyclictest0-21swapper/023:05:480
2504599240,23cyclictest0-21swapper/022:54:350
2504599240,23cyclictest0-21swapper/022:05:180
2504599240,23cyclictest0-21swapper/021:59:240
2504599240,20cyclictest0-21swapper/021:22:240
2504599240,0cyclictest18712-21diskmemload23:25:220
2504599240,0cyclictest0-21swapper/021:41:130
2504599240,0cyclictest0-21swapper/021:13:310
25048992323,0cyclictest18712-21diskmemload23:51:473
25048992323,0cyclictest0-21swapper/323:05:303
25048992323,0cyclictest0-21swapper/300:31:003
25048992321,1cyclictest34-21ksoftirqd/321:30:013
25048992319,3cyclictest13248-21apt-get19:54:093
2504899230,23cyclictest0-21swapper/321:56:263
2504899230,23cyclictest0-21swapper/300:20:133
2504899230,23cyclictest0-21swapper/300:06:203
2504899230,22cyclictest22531-21sh23:47:053
2504899230,22cyclictest18712-21diskmemload23:20:433
2504899230,22cyclictest0-21swapper/320:59:083
2504899230,22cyclictest0-21swapper/300:11:163
2504899230,1cyclictest18712-21diskmemload21:48:093
2504899230,0cyclictest18712-21diskmemload23:14:563
2504899230,0cyclictest18712-21diskmemload22:50:023
2504899230,0cyclictest0-21swapper/322:17:533
2504899230,0cyclictest0-21swapper/322:10:193
25047992323,0cyclictest18712-21diskmemload22:56:302
25047992323,0cyclictest0-21swapper/223:22:192
25047992323,0cyclictest0-21swapper/222:26:582
25047992323,0cyclictest0-21swapper/222:00:492
25047992321,1cyclictest8097-21ssh21:31:022
25047992321,1cyclictest0-21swapper/223:31:072
25047992320,0cyclictest0-21swapper/222:32:312
2504799230,3cyclictest0-21swapper/221:36:322
2504799230,2cyclictest6776-21ssh23:00:582
2504799230,2cyclictest18712-21diskmemload22:51:262
2504799230,23cyclictest18712-21diskmemload23:45:582
2504799230,23cyclictest0-21swapper/221:45:382
2504799230,23cyclictest0-21swapper/200:17:322
2504799230,22cyclictest31500-21ssh00:25:262
2504799230,22cyclictest30186-21ssh21:51:212
2504799230,22cyclictest29806-21ssh21:20:482
2504799230,22cyclictest25082-21sh22:48:352
2504799230,22cyclictest17623-21ssh23:42:422
2504799230,22cyclictest0-21swapper/221:56:082
2504799230,0cyclictest0-21swapper/222:36:202
2504799230,0cyclictest0-21swapper/221:14:532
25046992323,0cyclictest18712-21diskmemload21:23:391
25046992323,0cyclictest0-21swapper/123:49:581
25046992323,0cyclictest0-21swapper/121:40:391
25046992322,1cyclictest31957-21ssh23:24:411
25046992321,1cyclictest0-21swapper/100:38:471
25046992320,2cyclictest28160-21sh23:52:521
2504699230,23cyclictest0-21swapper/123:27:471
2504699230,23cyclictest0-21swapper/121:33:081
2504699230,22cyclictest5540-21sh00:32:061
2504699230,22cyclictest0-21swapper/123:19:191
2504699230,22cyclictest0-21swapper/100:19:141
2504699230,22cyclictest0-21swapper/100:07:161
2504699230,0cyclictest0-21swapper/122:42:111
2504699230,0cyclictest0-21swapper/122:27:501
2504699230,0cyclictest0-21swapper/121:51:191
25045992323,0cyclictest0-21swapper/000:31:020
2504599232,2cyclictest11065-21cstates19:49:090
25045992321,1cyclictest7848-21sh19:40:010
25045992321,1cyclictest0-21swapper/023:40:430
25045992321,1cyclictest0-21swapper/021:38:090
25045992319,4cyclictest18712-21diskmemload00:37:360
25045992318,5cyclictest29332-21sh21:50:050
2504599230,23cyclictest0-21swapper/023:50:120
2504599230,23cyclictest0-21swapper/022:57:250
2504599230,23cyclictest0-21swapper/000:05:230
2504599230,22cyclictest18712-21diskmemload22:29:140
2504599230,1cyclictest18712-21diskmemload23:36:030
2504599230,1cyclictest18712-21diskmemload23:31:220
2504599230,0cyclictest0-21swapper/023:00:500
25048992222,0cyclictest0-21swapper/323:35:013
25048992222,0cyclictest0-21swapper/323:26:393
25048992222,0cyclictest0-21swapper/321:13:243
25048992222,0cyclictest0-21swapper/300:38:533
25048992222,0cyclictest0-21swapper/300:17:173
25048992220,1cyclictest9145-21munin-run20:50:003
25048992220,1cyclictest10851-21apt-get19:49:083
25048992220,1cyclictest1040-21ssh00:28:253
25048992220,1cyclictest0-21swapper/322:05:493
25048992219,2cyclictest30301-21sh21:51:303
2504899220,21cyclictest7926-21ssh23:02:453
2504899220,21cyclictest18712-21diskmemload21:15:443
2504899220,21cyclictest11713-21ssh22:34:293
2504899220,21cyclictest0-21swapper/322:56:483
2504899220,21cyclictest0-21swapper/322:35:043
2504899220,21cyclictest0-21swapper/319:44:083
2504899220,21cyclictest0-21swapper/319:35:023
2504899220,1cyclictest26535-21ssh23:19:263
2504899220,1cyclictest25254-21apt-get20:19:103
2504899220,1cyclictest17013-21sh23:41:403
2504899220,1cyclictest1326-21ssh23:58:263
2504899220,0cyclictest18712-21diskmemload21:35:523
2504899220,0cyclictest0-21swapper/300:00:133
25047992222,0cyclictest18712-21diskmemload22:24:022
25047992222,0cyclictest0-21swapper/223:51:232
25047992222,0cyclictest0-21swapper/200:35:392
25047992221,0cyclictest27671-21apt-get20:24:102
25047992220,1cyclictest0-21swapper/223:55:412
2504799221,1cyclictest1503-21diskmemload23:27:222
2504799220,22cyclictest0-21swapper/223:36:272
2504799220,21cyclictest17848-21ssh22:40:322
2504799220,21cyclictest0-21swapper/223:10:262
2504799220,21cyclictest0-21swapper/220:29:092
2504799220,21cyclictest0-21swapper/200:20:022
2504799220,1cyclictest5072-21ssh00:00:492
2504799220,1cyclictest0-21swapper/221:40:192
25046992220,1cyclictest0-21swapper/123:05:181
25046992220,1cyclictest0-21swapper/121:55:151
25046992220,1cyclictest0-21swapper/120:00:011
25046992219,2cyclictest31483-21sh00:25:251
2504699220,21cyclictest5075-21apt-get19:35:021
2504699220,21cyclictest0-21swapper/122:45:341
2504699220,21cyclictest0-21swapper/119:49:081
25045992222,0cyclictest0-21swapper/019:34:080
25045992220,2cyclictest0-21swapper/023:12:110
25045992219,3cyclictest0-21swapper/000:17:380
2504599221,0cyclictest0-21swapper/022:00:050
2504599220,2cyclictest6578-21grep20:44:180
2504599220,21cyclictest12103-21apt-get20:59:090
2504599220,21cyclictest0-21swapper/022:10:360
2504599220,21cyclictest0-21swapper/021:25:140
2504599220,21cyclictest0-21swapper/021:09:090
2504599220,21cyclictest0-21swapper/020:19:090
2504899210,21cyclictest18059-21apt-get20:04:083
2504899210,21cyclictest0-21swapper/320:34:103
2504899210,0cyclictest18712-21diskmemload22:00:273
25047992121,0cyclictest0-21swapper/200:10:242
2504799210,21cyclictest0-21swapper/222:10:162
2504799210,20cyclictest0-21swapper/221:04:082
2504799210,1cyclictest32464-21apt-get20:34:102
2504799210,0cyclictest8456-21apt-get19:44:082
25046992121,0cyclictest0-21swapper/121:45:211
25046992121,0cyclictest0-21swapper/119:29:081
25046992119,1cyclictest0-21swapper/120:05:001
2504699210,21cyclictest18712-21diskmemload23:30:531
2504699210,21cyclictest0-21swapper/119:54:091
2504699210,21cyclictest0-21swapper/119:34:081
2504699210,20cyclictest0-21swapper/120:24:101
2504699210,0cyclictest0-21swapper/122:10:181
2504699210,0cyclictest0-21swapper/119:14:091
25045992119,1cyclictest19885-21munin-run20:05:000
2504599210,20cyclictest9129-21perf20:50:000
2504599210,20cyclictest30219-21turbostat19:20:000
2504599210,20cyclictest0-21swapper/019:44:080
2504599210,1cyclictest0-21swapper/020:34:120
2504599210,0cyclictest14516-21apt-get21:04:080
2504599210,0cyclictest0-21swapper/020:24:100
2504599210,0cyclictest0-21swapper/019:14:080
25048992020,0cyclictest9708-21apt-get20:54:093
25047992020,0cyclictest15645-21apt-get19:59:092
25047992020,0cyclictest0-21swapper/220:44:082
2504699200,0cyclictest0-21swapper/120:19:101
25045992015,5cyclictest0-21swapper/019:59:100
25048991919,0cyclictest0-21swapper/320:44:083
25048991919,0cyclictest0-21swapper/319:14:093
25048991918,0cyclictest20453-21apt-get20:09:083
25048991917,1cyclictest3199-21apt-get19:34:083
25048991916,2cyclictest28920-21tune2fs19:19:113
25047991919,0cyclictest25606-21apt-get19:14:092
25047991919,0cyclictest22848-21apt-get20:14:092
25047991919,0cyclictest16912-21apt-get21:09:092
25046991919,0cyclictest0-21swapper/120:44:081
25046991917,1cyclictest30219-21turbostat.cron19:20:001
25045991919,0cyclictest0-21swapper/020:14:090
25045991919,0cyclictest0-21swapper/019:24:100
2504599190,18cyclictest0-21swapper/020:54:110
25048991818,0cyclictest0-21swapper/320:24:103
2504899180,18cyclictest0-21swapper/320:39:103
25047991818,0cyclictest0-21swapper/220:54:092
25047991818,0cyclictest0-21swapper/219:49:082
25047991818,0cyclictest0-21swapper/219:19:092
25046991817,0cyclictest30816-21apt-get19:24:101
25045991815,3cyclictest0-21swapper/020:39:090
25048991717,0cyclictest778-21apt-get19:29:093
25047991717,0cyclictest0-21swapper/220:39:102
25047991717,0cyclictest0-21swapper/220:04:092
25046991717,0cyclictest0-21swapper/120:34:101
25046991717,0cyclictest0-21swapper/120:09:081
25046991715,1cyclictest0-21swapper/120:54:091
2504599170,0cyclictest0-21swapper/020:09:080
25048991616,0cyclictest0-21swapper/320:14:093
2504899160,14cyclictest0-21swapper/319:20:423
25047991614,1cyclictest0-21swapper/220:19:102
25047991614,1cyclictest0-21swapper/219:35:002
25045991614,2cyclictest0-21swapper/020:29:090
2504599160,1cyclictest0-21swapper/019:54:180
2504599160,0cyclictest0-21swapper/019:27:520
25048991513,1cyclictest16691-21ntp_states19:59:173
25047991513,1cyclictest0-21swapper/221:00:002
2504799150,1cyclictest0-21swapper/219:37:162
25048991414,0cyclictest0-21swapper/321:02:013
2504899140,14cyclictest0-21swapper/321:06:403
2504899140,14cyclictest0-21swapper/320:25:483
25047991414,0cyclictest0-21swapper/219:50:522
2504799140,14cyclictest0-21swapper/220:47:292
2504799140,14cyclictest0-21swapper/220:05:242
2504799140,14cyclictest0-21swapper/219:25:212
2504799140,14cyclictest0-21swapper/219:21:012
25046991414,0cyclictest0-21swapper/120:10:241
2504699140,14cyclictest0-21swapper/120:47:241
2504699140,14cyclictest0-21swapper/120:35:081
2504699140,0cyclictest0-21swapper/121:00:341
2504699140,0cyclictest0-21swapper/119:40:211
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional