You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-24 - 04:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5s.osadl.org (updated Tue Mar 24, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1729699290,28cyclictest11642-21diskmemload00:38:593
1729699280,21cyclictest21699-21apt-get20:25:023
1729699270,22cyclictest0-21swapper/322:27:003
17296992621,1cyclictest11642-21diskmemload23:52:413
1729699260,21cyclictest31776-21rm21:29:463
1729699260,1cyclictest27005-21sh00:34:463
1729699260,0cyclictest0-21swapper/322:56:043
1728499260,25cyclictest29350-21sh00:05:310
17296992521,0cyclictest11642-21diskmemload23:15:443
17296992519,1cyclictest11900-21ssh23:48:443
17295992523,1cyclictest0-21swapper/200:32:462
1729599250,24cyclictest0-21swapper/223:32:102
1729599250,24cyclictest0-21swapper/221:41:242
1729299250,24cyclictest0-21swapper/123:36:541
1729299250,24cyclictest0-21swapper/123:36:541
17284992519,5cyclictest9760-21sendmail-msp21:40:000
1728499250,24cyclictest11642-21diskmemload23:28:540
1728499250,24cyclictest11642-21diskmemload21:28:110
1728499250,0cyclictest0-21swapper/023:33:150
1729699240,24cyclictest0-21swapper/322:03:423
1729699240,23cyclictest11642-21diskmemload22:11:413
1729699240,23cyclictest11642-21diskmemload21:37:273
1729699240,23cyclictest0-21swapper/323:11:483
1729699240,23cyclictest0-21swapper/300:07:213
1729699240,23cyclictest0-21swapper/300:00:583
17295992424,0cyclictest11642-21diskmemload21:13:462
17295992422,0cyclictest0-21swapper/221:22:552
1729599240,24cyclictest11642-21diskmemload22:44:172
1729599240,24cyclictest0-21swapper/221:15:392
1729599240,23cyclictest11642-21diskmemload22:08:272
1729299241,1cyclictest23215-21cron00:00:001
1729299240,24cyclictest0-21swapper/122:00:281
1729299240,24cyclictest0-21swapper/121:14:251
1729299240,24cyclictest0-21swapper/100:16:231
1729299240,24cyclictest0-21swapper/100:11:231
1729299240,23cyclictest24104-21sh00:32:471
1729299240,23cyclictest11642-21diskmemload21:32:431
1729299240,23cyclictest0-21swapper/121:22:481
1729299240,0cyclictest0-21swapper/123:52:171
17284992423,0cyclictest0-21swapper/022:01:050
1728499241,22cyclictest20224-21rm21:50:110
1728499240,23cyclictest7290-21ssh00:15:190
1728499240,23cyclictest25184-21/usr/sbin/munin22:57:550
1728499240,23cyclictest11642-21diskmemload23:12:450
1728499240,23cyclictest0-21swapper/000:12:260
1728499240,22cyclictest8972-21rm22:10:240
1728499240,22cyclictest11484-21rm23:17:440
1728499240,1cyclictest31872-21apt-get23:37:470
1728499240,1cyclictest31872-21apt-get23:37:470
17296992321,1cyclictest0-21swapper/322:22:503
1729699230,2cyclictest21619-21ssh23:27:333
1729699230,2cyclictest10892-21ssh22:43:533
1729699230,23cyclictest0-21swapper/323:06:053
1729699230,23cyclictest0-21swapper/322:50:113
1729699230,23cyclictest0-21swapper/322:37:193
1729699230,22cyclictest1185-21sh22:34:343
1729699230,22cyclictest11642-21diskmemload22:49:323
1729699230,22cyclictest0-21swapper/323:57:493
1729699230,1cyclictest0-21swapper/323:03:143
1729699230,0cyclictest0-21swapper/320:57:483
17295992323,0cyclictest0-21swapper/223:25:392
17295992323,0cyclictest0-21swapper/223:13:162
17295992323,0cyclictest0-21swapper/221:50:142
17295992322,1cyclictest11642-21diskmemload00:20:062
17295992321,2cyclictest15453-21rm23:20:512
17295992321,1cyclictest0-21swapper/220:00:002
17295992320,0cyclictest0-21swapper/200:06:352
1729599230,23cyclictest0-21swapper/221:48:522
1729599230,23cyclictest0-21swapper/221:25:232
1729599230,23cyclictest0-21swapper/200:14:092
1729599230,22cyclictest31774-21sh23:37:422
1729599230,22cyclictest31774-21sh23:37:422
1729599230,22cyclictest21740-21ssh23:57:582
1729599230,22cyclictest21134-21kworker/u8:121:55:282
1729599230,22cyclictest16858-21dump-pmu-power20:15:012
1729599230,22cyclictest11642-21diskmemload00:29:182
1729599230,20cyclictest0-21swapper/223:48:262
1729599230,1cyclictest0-21swapper/223:16:202
1729599230,0cyclictest11642-21diskmemload22:01:482
1729599230,0cyclictest0-21swapper/222:36:132
1729599230,0cyclictest0-21swapper/221:39:552
1729599230,0cyclictest0-21swapper/200:01:092
17292992323,0cyclictest0-21swapper/123:48:371
17292992323,0cyclictest0-21swapper/122:25:481
17292992321,1cyclictest1205-21sh22:34:361
17292992321,1cyclictest0-21swapper/123:16:021
17292992321,1cyclictest0-21swapper/122:40:471
17292992321,1cyclictest0-21swapper/122:16:141
1729299231,21cyclictest18665-21apt-get22:52:481
1729299230,23cyclictest0-21swapper/100:37:541
1729299230,23cyclictest0-21swapper/100:26:371
1729299230,22cyclictest7777-21ssh22:08:511
1729299230,22cyclictest7133-21fschecks_time21:37:501
1729299230,22cyclictest22309-21ssh22:55:291
1729299230,22cyclictest11886-21cstates21:42:481
1729299230,22cyclictest0-21swapper/123:42:241
1729299230,22cyclictest0-21swapper/123:22:511
1729299230,0cyclictest0-21swapper/123:25:081
17284992323,0cyclictest0-21swapper/021:34:060
17284992323,0cyclictest0-21swapper/000:39:390
1728499230,23cyclictest11642-21diskmemload21:48:520
1728499230,23cyclictest11642-21diskmemload21:20:480
1728499230,23cyclictest11642-21diskmemload21:16:020
1728499230,23cyclictest0-21swapper/023:51:310
1728499230,23cyclictest0-21swapper/022:25:480
1728499230,22cyclictest6158-21sh22:39:200
1728499230,22cyclictest4526-21apt-get23:42:480
1728499230,22cyclictest17550-21ssh22:18:080
1728499230,0cyclictest11642-21diskmemload23:23:530
1728499230,0cyclictest0-21swapper/023:59:590
1728499230,0cyclictest0-21swapper/000:00:320
17296992222,0cyclictest11642-21diskmemload21:59:273
17296992222,0cyclictest0-21swapper/323:20:163
17296992222,0cyclictest0-21swapper/300:18:133
17296992221,1cyclictest606-21dbus-daemon19:30:013
17296992221,1cyclictest4089-21sh22:05:403
17296992221,1cyclictest0-21swapper/300:10:013
17296992220,2cyclictest17689-21rm00:25:483
17296992220,1cyclictest4813-21awk19:50:013
17296992220,1cyclictest32155-21apt-get20:47:483
17296992220,1cyclictest10435-21sh21:40:523
17296992220,1cyclictest0-21swapper/321:51:163
1729699220,22cyclictest11642-21diskmemload23:40:083
1729699220,22cyclictest0-21swapper/323:30:123
1729699220,21cyclictest24944-21apt-get20:32:453
1729699220,21cyclictest22445-21perf19:20:003
1729699220,21cyclictest11642-21diskmemload21:20:263
1729699220,21cyclictest0-21swapper/321:15:143
1729699220,21cyclictest0-21swapper/321:10:193
1729699220,1cyclictest30801-21ssh23:36:033
1729699220,1cyclictest30801-21ssh23:36:033
1729699220,1cyclictest0-21swapper/300:20:553
1729699220,0cyclictest0-21swapper/322:16:563
17295992222,0cyclictest0-21swapper/223:00:542
17295992222,0cyclictest0-21swapper/222:12:182
17295992220,0cyclictest0-21swapper/222:56:552
1729599220,22cyclictest0-21swapper/200:16:172
1729599220,21cyclictest0-21swapper/223:05:362
1729599220,21cyclictest0-21swapper/222:45:522
1729599220,21cyclictest0-21swapper/222:25:022
1729599220,21cyclictest0-21swapper/222:20:262
1729599220,21cyclictest0-21swapper/221:30:422
1729599220,21cyclictest0-21swapper/200:35:312
1729599220,1cyclictest11642-21diskmemload23:51:002
1729599220,1cyclictest0-21swapper/222:30:352
1729599220,0cyclictest0-21swapper/222:17:232
17292992222,0cyclictest0-21swapper/122:36:501
17292992222,0cyclictest0-21swapper/121:55:391
17292992222,0cyclictest0-21swapper/121:51:391
17292992222,0cyclictest0-21swapper/121:47:001
17292992222,0cyclictest0-21swapper/100:00:381
17292992220,1cyclictest313-21systemd-journal21:05:001
17292992220,1cyclictest31248-21df00:07:501
17292992220,1cyclictest27060-21ssh23:00:051
1729299220,22cyclictest0-21swapper/123:30:431
1729299220,21cyclictest24944-21apt-get20:32:451
1729299220,21cyclictest22905-21apt-get19:22:461
1729299220,21cyclictest0-21swapper/122:12:511
1729299220,1cyclictest0-21swapper/121:26:181
1729299220,0cyclictest11642-21diskmemload22:23:021
1729299220,0cyclictest0-21swapper/123:11:131
17284992222,0cyclictest0-21swapper/022:47:350
17284992222,0cyclictest0-21swapper/022:40:280
17284992222,0cyclictest0-21swapper/022:30:030
17284992222,0cyclictest0-21swapper/020:17:480
17284992221,1cyclictest19605-21ssh22:21:050
17284992221,1cyclictest11533-21ssh21:42:380
17284992221,1cyclictest0-21swapper/022:05:020
17284992220,1cyclictest9258-21cron21:05:000
17284992220,1cyclictest25302-21apt-get19:27:470
1728499220,21cyclictest62550irq/127-eno123:00:260
1728499220,21cyclictest12245-21rm00:20:100
1728499220,21cyclictest0-21swapper/023:05:390
1728499220,21cyclictest0-21swapper/021:55:010
1728499220,21cyclictest0-21swapper/019:37:480
1728499220,21cyclictest0-21swapper/000:30:070
1728499220,1cyclictest62550irq/127-eno123:47:240
1728499220,0cyclictest19098-21ssh22:52:500
17296992120,1cyclictest0-21swapper/320:22:483
1729699210,0cyclictest7679-21apt-get19:57:463
1729699210,0cyclictest0-21swapper/321:45:453
1729699210,0cyclictest0-21swapper/321:30:103
1729699210,0cyclictest0-21swapper/320:05:003
1729599210,21cyclictest11642-21diskmemload23:41:312
1729599210,1cyclictest18093-21apt-get19:12:462
1729599210,0cyclictest0-21swapper/220:37:492
17292992121,0cyclictest0-21swapper/120:17:481
17292992119,1cyclictest14463-21latency_hist20:10:001
1729299210,21cyclictest0-21swapper/123:05:231
1729299210,21cyclictest0-21swapper/100:20:041
1729299210,20cyclictest20489-21apt-get19:17:461
1729299210,20cyclictest0-21swapper/119:47:471
17284992119,1cyclictest606-21dbus-daemon20:10:000
17284992119,1cyclictest4078-21munin-run20:55:000
1728499210,1cyclictest0-21swapper/019:47:470
1729699200,20cyclictest0-21swapper/321:07:483
1729699200,20cyclictest0-21swapper/320:37:493
1729699200,0cyclictest0-21swapper/320:42:503
17295992020,0cyclictest4060-21apt-get20:55:022
17295992020,0cyclictest0-21swapper/219:27:482
17295992020,0cyclictest0-21swapper/219:22:462
17295992019,1cyclictest0-21swapper/220:42:502
1729599200,0cyclictest32510-21apt-get19:42:462
17292992020,0cyclictest0-21swapper/120:37:491
17292992020,0cyclictest0-21swapper/119:12:461
17284992019,0cyclictest0-21swapper/020:55:020
17284992018,1cyclictest26886-21munin-plugin-st20:35:010
17296991919,0cyclictest0-21swapper/320:07:473
1729699190,18cyclictest4070-21perf20:55:003
17295991919,0cyclictest0-21swapper/220:52:482
17292991919,0cyclictest0-21swapper/120:52:481
17292991919,0cyclictest0-21swapper/119:27:471
1729299191,8cyclictest0-21swapper/119:32:451
17284991919,0cyclictest0-21swapper/019:17:460
17295991818,0cyclictest0-21swapper/219:17:462
17295991817,1cyclictest11670-21perf21:10:012
17292991818,0cyclictest0-21swapper/120:55:021
17284991818,0cyclictest0-21swapper/019:12:460
1728499180,17cyclictest0-21swapper/020:02:480
17295991717,0cyclictest0-21swapper/220:22:482
17295991717,0cyclictest0-21swapper/219:37:482
17292991717,0cyclictest0-21swapper/119:52:481
17284991717,0cyclictest0-21swapper/021:07:480
17284991717,0cyclictest0-21swapper/019:22:460
17284991716,0cyclictest0-21swapper/020:47:480
17296991616,0cyclictest17186-21apt-get19:10:013
17296991615,1cyclictest0-21swapper/319:52:483
17295991616,0cyclictest0-21swapper/219:32:452
17295991615,1cyclictest17345-21apt-get20:17:482
1729599160,1cyclictest1665-21perf20:50:002
17292991615,0cyclictest21699-21apt-get20:25:021
17292991615,0cyclictest0-21swapper/120:47:481
17292991615,0cyclictest0-21swapper/119:42:461
17284991616,0cyclictest5286-21apt-get19:52:480
17284991616,0cyclictest0-21swapper/019:42:460
17284991614,1cyclictest29762-21apt-get20:42:500
17296991515,0cyclictest0-21swapper/320:17:483
17295991513,1cyclictest0-21swapper/219:52:522
17284991515,0cyclictest0-21swapper/020:25:020
17296991414,0cyclictest0-21swapper/319:20:403
1729699140,14cyclictest0-21swapper/321:00:223
1729699140,14cyclictest0-21swapper/320:10:313
1729699140,14cyclictest0-21swapper/319:35:253
1729699140,14cyclictest0-21swapper/319:31:403
1729699140,0cyclictest0-21swapper/319:41:343
17295991414,0cyclictest0-21swapper/221:00:302
17295991414,0cyclictest0-21swapper/220:25:022
17295991414,0cyclictest0-21swapper/220:05:062
1729599140,0cyclictest0-21swapper/220:30:022
1729599140,0cyclictest0-21swapper/220:00:292
1729599140,0cyclictest0-21swapper/219:45:232
1729299140,14cyclictest0-21swapper/120:20:101
1729299140,0cyclictest0-21swapper/120:11:111
17284991414,0cyclictest0-21swapper/020:20:140
17284991414,0cyclictest0-21swapper/019:55:520
17284991414,0cyclictest0-21swapper/019:30:010
1728499140,0cyclictest0-21swapper/020:11:180
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional