You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-15 - 14:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Tue Sep 15, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
21705992822,5cyclictest18353-21ssh00:05:543
21705992720,6cyclictest26224-21apt-get20:27:183
2170599270,26cyclictest0-21swapper/300:22:223
2170599260,25cyclictest23280-21ssh21:45:453
21705992519,5cyclictest15362-21diskmemload23:47:183
2170599250,24cyclictest15362-21diskmemload22:12:573
2170599250,24cyclictest15362-21diskmemload00:30:113
2170599250,24cyclictest0-21swapper/323:15:003
2170599250,24cyclictest0-21swapper/322:01:113
2170599250,1cyclictest0-21swapper/321:10:073
21703992522,0cyclictest0-21swapper/223:12:532
2170199252,22cyclictest7282-21chrt23:56:211
2170199250,24cyclictest0-21swapper/100:03:511
21697992523,1cyclictest0-21swapper/022:47:190
2169799250,24cyclictest0-21swapper/000:24:280
2169799250,1cyclictest15362-21diskmemload22:30:260
21705992424,0cyclictest0-21swapper/300:04:463
21705992422,2cyclictest0-21swapper/323:28:573
21705992422,1cyclictest7314-21ssh22:29:103
21705992421,3cyclictest0-21swapper/323:54:313
2170599240,23cyclictest15362-21diskmemload23:35:243
2170599240,23cyclictest0-21swapper/322:58:023
2170599240,23cyclictest0-21swapper/322:40:413
2170599240,21cyclictest0-21swapper/323:04:253
2170599240,20cyclictest0-21swapper/300:36:233
2170599240,1cyclictest0-21swapper/322:33:123
21703992422,1cyclictest18094-21ssh23:07:272
21703992420,1cyclictest0-21swapper/221:48:442
2170399241,23cyclictest10609-21kworker/u8:100:06:372
2170399240,23cyclictest15362-21diskmemload23:18:342
2170399240,0cyclictest0-21swapper/222:24:492
21701992424,0cyclictest0-21swapper/100:21:441
21701992421,2cyclictest18312-21sh00:34:081
2170199240,24cyclictest0-21swapper/122:23:071
2170199240,23cyclictest15362-21diskmemload22:42:521
2170199240,23cyclictest11397-21sh23:31:091
2170199240,23cyclictest11240-21apt-get23:02:201
2170199240,23cyclictest1100-21ssh23:50:521
2170199240,23cyclictest0-21swapper/122:30:291
2170199240,0cyclictest0-21swapper/121:46:431
21697992423,1cyclictest15362-21diskmemload21:33:420
2169799240,24cyclictest15362-21diskmemload21:10:410
2169799240,24cyclictest0-21swapper/000:05:420
2169799240,23cyclictest24107-21sh00:11:080
2169799240,23cyclictest19464-21ssh00:35:240
2169799240,23cyclictest18500-21cron20:10:000
2169799240,23cyclictest13687-21taskset22:35:020
2169799240,23cyclictest13687-21taskset22:35:020
21705992323,0cyclictest0-21swapper/322:23:493
21705992322,1cyclictest21875-21ssh21:44:103
21705992322,1cyclictest0-21swapper/322:05:533
21705992321,1cyclictest0-21swapper/323:40:113
21705992320,3cyclictest0-21swapper/321:55:023
21705992320,2cyclictest25068-21sh00:12:203
2170599230,23cyclictest15362-21diskmemload22:37:153
2170599230,23cyclictest15362-21diskmemload22:37:153
2170599230,23cyclictest0-21swapper/322:19:203
2170599230,23cyclictest0-21swapper/319:37:183
2170599230,22cyclictest31230-21sh22:51:013
2170599230,22cyclictest13765-21sh21:37:213
2170599230,22cyclictest1011-21expr23:22:173
2170599230,22cyclictest0-21swapper/321:15:093
2170599230,0cyclictest0-21swapper/323:55:233
2170599230,0cyclictest0-21swapper/321:27:103
2170599230,0cyclictest0-21swapper/321:24:373
21703992323,0cyclictest22114-21apt-get19:12:202
21703992323,0cyclictest0-21swapper/222:48:182
21703992323,0cyclictest0-21swapper/200:15:192
21703992322,1cyclictest15362-21diskmemload21:35:432
21703992322,1cyclictest13579-21ssh00:02:052
21703992322,1cyclictest0-21swapper/222:25:092
21703992321,1cyclictest0-21swapper/221:40:452
21703992321,1cyclictest0-21swapper/221:21:542
2170399231,21cyclictest494-21cron20:40:002
2170399230,2cyclictest0-21swapper/222:34:082
2170399230,23cyclictest0-21swapper/223:55:492
2170399230,22cyclictest4612-21ssh23:53:112
2170399230,22cyclictest26019-21sh23:43:392
2170399230,22cyclictest0-21swapper/221:50:562
2170399230,1cyclictest15362-21diskmemload21:57:482
2170399230,0cyclictest0-21swapper/223:31:072
2170399230,0cyclictest0-21swapper/222:41:162
2170399230,0cyclictest0-21swapper/222:36:142
2170399230,0cyclictest0-21swapper/222:36:142
21701992323,0cyclictest15362-21diskmemload23:12:231
21701992323,0cyclictest0-21swapper/123:29:531
21701992323,0cyclictest0-21swapper/122:25:021
21701992323,0cyclictest0-21swapper/121:10:491
21701992323,0cyclictest0-21swapper/100:12:191
21701992322,1cyclictest3836-21ssh22:55:211
21701992321,1cyclictest8496-21sh00:25:481
21701992321,1cyclictest7030-21sh21:31:161
21701992321,1cyclictest25182-21sh22:45:181
21701992321,1cyclictest0-21swapper/122:07:201
2170199230,22cyclictest32478-21sh23:21:251
2170199230,22cyclictest27134-21rm23:16:171
2170199230,22cyclictest24065-21idleruntime-cro19:15:001
2170199230,22cyclictest21993-21ssh21:44:201
2170199230,22cyclictest16643-21rm23:35:431
2170199230,22cyclictest13859-21sh22:35:161
2170199230,22cyclictest13859-21sh22:35:161
2170199230,1cyclictest15362-21diskmemload23:42:481
2170199230,1cyclictest15362-21diskmemload21:36:561
2170199230,1cyclictest0-21swapper/121:26:141
2170199230,0cyclictest0-21swapper/123:46:481
2170199230,0cyclictest0-21swapper/122:52:371
21697992323,0cyclictest62550irq/127-eno100:04:480
21697992323,0cyclictest15362-21diskmemload21:17:060
21697992323,0cyclictest0-21swapper/023:32:040
21697992323,0cyclictest0-21swapper/022:15:500
21697992323,0cyclictest0-21swapper/022:09:120
21697992323,0cyclictest0-21swapper/021:39:460
21697992321,1cyclictest6914-21ssh23:55:540
21697992321,1cyclictest4831-21perl22:27:210
21697992321,1cyclictest1330-21munin-run19:35:010
21697992320,2cyclictest32058-21ssh21:52:460
2169799230,23cyclictest8895-21ssh23:00:000
2169799230,23cyclictest15362-21diskmemload23:38:250
2169799230,23cyclictest0-21swapper/023:14:120
2169799230,23cyclictest0-21swapper/022:43:200
2169799230,22cyclictest1111-21sh21:25:500
2169799230,21cyclictest19263-21sh23:08:270
2169799230,21cyclictest0-21swapper/023:47:330
2169799230,0cyclictest15362-21diskmemload21:48:200
2169799230,0cyclictest15362-21diskmemload21:20:270
2169799230,0cyclictest0-21swapper/022:52:550
2169799230,0cyclictest0-21swapper/022:22:510
2169799230,0cyclictest0-21swapper/021:42:440
2169799230,0cyclictest0-21swapper/000:34:090
2169799230,0cyclictest0-21swapper/000:26:140
21705992220,2cyclictest0-21swapper/323:15:143
21705992220,1cyclictest18541-21munin-run20:10:003
21705992219,3cyclictest0-21swapper/300:16:153
2170599220,21cyclictest15362-21diskmemload21:30:413
2170599220,21cyclictest0-21swapper/320:47:213
2170599220,21cyclictest0-21swapper/300:25:103
2170599220,1cyclictest16120-21latency_hist20:05:003
21703992222,0cyclictest15362-21diskmemload21:11:102
21703992222,0cyclictest0-21swapper/223:25:372
21703992222,0cyclictest0-21swapper/222:57:242
21703992222,0cyclictest0-21swapper/220:07:202
21703992221,1cyclictest23018-21diskmemload00:37:472
21703992220,1cyclictest31599-21sh22:51:402
21703992220,1cyclictest0-21swapper/221:31:482
21703992219,3cyclictest0-21swapper/222:10:492
2170399220,22cyclictest15362-21diskmemload23:36:022
2170399220,21cyclictest8974-21sh00:26:242
2170399220,21cyclictest16106-21cron20:05:002
2170399220,21cyclictest0-21swapper/222:00:502
2170399220,21cyclictest0-21swapper/221:25:082
2170399220,21cyclictest0-21swapper/200:33:362
2170399220,1cyclictest26904-21sh00:12:292
2170399220,1cyclictest0-21swapper/223:46:062
2170399220,1cyclictest0-21swapper/222:15:082
2170399220,0cyclictest0-21swapper/223:22:462
21701992222,0cyclictest0-21swapper/123:06:511
21701992222,0cyclictest0-21swapper/121:52:441
21701992222,0cyclictest0-21swapper/121:22:211
21701992222,0cyclictest0-21swapper/121:16:001
21701992222,0cyclictest0-21swapper/119:52:181
21701992220,2cyclictest7864-21ssh22:01:101
21701992220,1cyclictest0-21swapper/122:11:111
21701992220,1cyclictest0-21swapper/120:00:001
2170199220,2cyclictest15392-21turbostat21:10:011
2170199220,22cyclictest21742-21ssh00:08:061
2170199220,22cyclictest0-21swapper/122:15:031
2170199220,21cyclictest6694-21ssh21:59:531
2170199220,21cyclictest29390-21ssh00:15:331
2170199220,1cyclictest20695-21rm00:36:551
21697992222,0cyclictest0-21swapper/023:20:460
21697992221,1cyclictest19417-21ssh22:11:380
21697992221,0cyclictest1018-21apt-get20:42:200
21697992220,1cyclictest557-21sh23:50:050
21697992220,1cyclictest0-21swapper/023:26:570
2169799220,22cyclictest0-21swapper/023:15:320
2169799220,21cyclictest62550irq/127-eno121:55:220
2169799220,21cyclictest15362-21diskmemload23:40:080
2169799220,21cyclictest0-21swapper/023:01:270
2169799220,21cyclictest0-21swapper/020:27:180
2169799220,1cyclictest0-21swapper/022:01:110
21705992120,1cyclictest15362-21diskmemload21:50:243
21705992119,1cyclictest0-21swapper/321:02:183
2170599210,20cyclictest0-21swapper/323:05:033
2170599210,20cyclictest0-21swapper/320:55:023
21703992121,0cyclictest0-21swapper/220:42:202
21703992121,0cyclictest0-21swapper/220:32:182
21703992118,2cyclictest313-21systemd-journal19:50:002
2170399210,21cyclictest0-21swapper/222:06:092
2170399210,20cyclictest0-21swapper/219:27:182
2170399210,1cyclictest21356-21apt-get20:17:202
2170399210,0cyclictest0-21swapper/219:22:192
2170399210,0cyclictest0-21swapper/200:21:552
21701992120,1cyclictest3425-21apt-get20:47:211
2170199210,20cyclictest0-21swapper/120:17:201
2170199210,1cyclictest7782-21apt-get20:55:021
2170199210,1cyclictest0-21swapper/120:07:201
2169799210,0cyclictest15362-21diskmemload00:16:130
2169799210,0cyclictest0-21swapper/020:32:180
2169799210,0cyclictest0-21swapper/020:12:190
2170599200,20cyclictest0-21swapper/320:42:193
2170599200,0cyclictest28620-21apt-get20:32:183
21703992020,0cyclictest18960-21apt-get20:12:192
21703992020,0cyclictest0-21swapper/220:57:182
21703992020,0cyclictest0-21swapper/219:37:182
2170399200,0cyclictest5819-21apt-get20:52:192
2170399200,0cyclictest0-21swapper/219:32:192
21701992020,0cyclictest6573-21apt-get19:47:201
21701992020,0cyclictest11026-21apt-get21:02:181
21701992020,0cyclictest0-21swapper/120:22:191
21701992019,1cyclictest0-21swapper/120:52:191
2170199200,20cyclictest0-21swapper/119:37:181
21697992020,0cyclictest8609-21apt-get20:57:180
21697992020,0cyclictest0-21swapper/019:52:180
21697992020,0cyclictest0-21swapper/019:47:200
21697992020,0cyclictest0-21swapper/019:42:180
21697992020,0cyclictest0-21swapper/019:27:190
2169799200,20cyclictest0-21swapper/020:52:190
2169799200,0cyclictest0-21swapper/020:02:190
21705991919,0cyclictest0-21swapper/319:32:193
21705991918,1cyclictest0-21swapper/319:22:193
21705991918,0cyclictest11755-21apt-get19:57:193
21703991919,0cyclictest0-21swapper/221:07:212
21703991919,0cyclictest0-21swapper/220:27:182
21703991919,0cyclictest0-21swapper/220:22:192
21703991919,0cyclictest0-21swapper/219:55:022
21701991919,0cyclictest0-21swapper/120:27:181
21701991918,0cyclictest0-21swapper/120:42:201
2170199190,0cyclictest0-21swapper/119:17:181
21697991919,0cyclictest0-21swapper/020:47:210
21697991918,1cyclictest0-21swapper/020:22:190
21705991818,0cyclictest0-21swapper/320:12:193
21705991818,0cyclictest0-21swapper/319:42:173
2170599180,6cyclictest10144-21awk19:52:253
2170599180,3cyclictest0-21swapper/320:52:183
2170599180,17cyclictest0-21swapper/319:47:203
21703991816,1cyclictest10938-21perf19:55:002
21701991817,1cyclictest28950-21perf19:25:001
2170199180,18cyclictest0-21swapper/120:37:201
21705991717,0cyclictest24506-21apt-get19:17:183
21705991717,0cyclictest0-21swapper/320:22:193
21705991716,1cyclictest31020-21apt-get20:37:203
21701991717,0cyclictest0-21swapper/119:42:171
21697991717,0cyclictest0-21swapper/021:07:200
21697991717,0cyclictest0-21swapper/020:37:200
21697991717,0cyclictest0-21swapper/019:57:180
2170599160,15cyclictest0-21swapper/321:10:013
2170399160,15cyclictest0-21swapper/220:47:252
21701991616,0cyclictest0-21swapper/119:27:191
21697991616,0cyclictest1755-21apt-get19:37:180
21697991613,2cyclictest28144-21grep19:22:250
2170599150,15cyclictest0-21swapper/319:11:013
2170599150,14cyclictest0-21swapper/320:17:203
2170399150,1cyclictest0-21swapper/221:05:012
21701991515,0cyclictest14173-21apt-get20:02:191
21701991515,0cyclictest0-21swapper/120:32:181
21697991513,1cyclictest23629-21cat19:12:280
2170599140,14cyclictest0-21swapper/319:28:023
2170399140,14cyclictest0-21swapper/219:40:312
2170399140,0cyclictest0-21swapper/219:15:182
2170199140,14cyclictest0-21swapper/119:30:581
2170199140,0cyclictest0-21swapper/120:10:331
21697991414,0cyclictest0-21swapper/020:15:420
2169799140,14cyclictest0-21swapper/021:01:090
2169799140,0cyclictest0-21swapper/019:15:170
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional