You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-16 - 01:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Mon Jun 15, 2026 00:44:25)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2263699330,0cyclictest0-21swapper/022:39:440
2263899260,1cyclictest16748-21diskmemload21:50:212
22637992621,2cyclictest15781-21ls22:10:001
22639992522,2cyclictest26251-21sh21:49:493
2263899250,24cyclictest753-21ssh23:29:212
2263899250,24cyclictest0-21swapper/223:53:162
2263899250,24cyclictest0-21swapper/223:42:582
2263799250,24cyclictest15834-21ssh23:12:061
22639992422,1cyclictest16748-21diskmemload00:14:503
22639992421,2cyclictest23496-21idleruntime-cro00:20:013
2263999240,2cyclictest313-21systemd-journal20:30:003
2263999240,24cyclictest0-21swapper/322:37:553
2263999240,23cyclictest16748-21diskmemload23:01:003
2263999240,0cyclictest0-21swapper/322:34:463
22638992422,1cyclictest22483-21ssh22:47:592
22638992422,1cyclictest0-21swapper/200:29:452
2263899240,23cyclictest3423-21ssh23:30:262
22637992422,1cyclictest2387-21ssh00:31:031
22637992421,2cyclictest24011-21ssh21:47:561
2263799241,22cyclictest32464-21perf21:55:011
2263799240,23cyclictest19477-21ssh00:16:341
2263799240,23cyclictest10737-21gltestperf00:39:471
2263799240,23cyclictest0-21swapper/122:42:521
2263799240,23cyclictest0-21swapper/122:21:141
2263799240,1cyclictest0-21swapper/123:54:051
2263699240,24cyclictest0-21swapper/023:37:470
2263699240,23cyclictest9350-21ssh00:38:340
2263699240,1cyclictest632-21ssh22:26:480
2263699240,0cyclictest0-21swapper/022:42:150
22639992323,0cyclictest16748-21diskmemload23:33:203
22639992323,0cyclictest0-21swapper/321:19:423
22639992322,1cyclictest0-21swapper/321:41:073
22639992321,1cyclictest21398-21sh22:46:213
22639992321,1cyclictest16748-21diskmemload23:20:003
22639992321,1cyclictest0-21swapper/321:36:453
22639992321,1cyclictest0-21swapper/321:20:103
2263999230,23cyclictest11352-21sh23:39:323
2263999230,23cyclictest0-21swapper/300:06:213
2263999230,22cyclictest3765-21ssh00:01:373
2263999230,22cyclictest3765-21ssh00:01:373
2263999230,22cyclictest30752-21ssh23:25:353
2263999230,22cyclictest0-21swapper/323:21:073
2263999230,1cyclictest313-21systemd-journal23:55:003
2263999230,1cyclictest0-21swapper/300:20:103
2263999230,0cyclictest17295-21apt-get20:09:433
2263999230,0cyclictest0-21swapper/323:44:233
2263999230,0cyclictest0-21swapper/323:08:593
2263999230,0cyclictest0-21swapper/321:11:013
2263999230,0cyclictest0-21swapper/300:38:453
22638992323,0cyclictest0-21swapper/223:48:432
22638992323,0cyclictest0-21swapper/223:15:042
22638992323,0cyclictest0-21swapper/222:10:032
22638992323,0cyclictest0-21swapper/222:01:072
22638992323,0cyclictest0-21swapper/221:46:402
22638992323,0cyclictest0-21swapper/221:18:012
22638992322,1cyclictest0-21swapper/200:00:452
22638992322,1cyclictest0-21swapper/200:00:452
22638992322,0cyclictest0-21swapper/222:06:092
22638992321,1cyclictest2443-21wc00:00:012
22638992321,1cyclictest0-21swapper/223:24:502
2263899230,22cyclictest18854-21rm00:15:432
2263899230,22cyclictest15732-21sh23:11:572
2263899230,22cyclictest0-21swapper/223:07:232
2263899230,22cyclictest0-21swapper/222:20:492
2263899230,22cyclictest0-21swapper/200:20:202
2263899230,0cyclictest0-21swapper/223:35:222
2263899230,0cyclictest0-21swapper/222:44:382
2263899230,0cyclictest0-21swapper/222:39:192
2263899230,0cyclictest0-21swapper/222:15:592
2263899230,0cyclictest0-21swapper/221:31:242
2263899230,0cyclictest0-21swapper/200:35:112
2263899230,0cyclictest0-21swapper/200:34:482
22637992323,0cyclictest16748-21diskmemload00:14:171
22637992323,0cyclictest0-21swapper/122:39:401
22637992323,0cyclictest0-21swapper/121:10:571
22637992321,1cyclictest606-21dbus-daemon19:45:001
22637992321,1cyclictest1880-21munin-run20:40:001
22637992321,1cyclictest10944-21perf21:35:011
22637992321,1cyclictest0-21swapper/123:55:491
22637992320,2cyclictest32234-21awk19:30:001
2263799230,2cyclictest5106-21sh21:59:541
2263799230,2cyclictest22205-21sh23:49:371
2263799230,23cyclictest0-21swapper/123:18:291
2263799230,23cyclictest0-21swapper/121:22:581
2263799230,23cyclictest0-21swapper/121:15:411
2263799230,23cyclictest0-21swapper/100:02:391
2263799230,23cyclictest0-21swapper/100:02:391
2263799230,22cyclictest606-21dbus-daemon19:20:011
2263799230,22cyclictest415-21ssh22:57:521
2263799230,22cyclictest2060-21/usr/sbin/munin23:29:491
2263799230,22cyclictest17472-21sh21:41:001
2263799230,22cyclictest16831-21ssh22:11:121
2263799230,0cyclictest16748-21diskmemload00:05:351
2263799230,0cyclictest0-21swapper/123:01:401
2263799230,0cyclictest0-21swapper/122:51:231
2263799230,0cyclictest0-21swapper/100:25:571
22636992323,0cyclictest16748-21diskmemload23:58:010
22636992323,0cyclictest0-21swapper/023:30:340
22636992323,0cyclictest0-21swapper/022:49:580
22636992323,0cyclictest0-21swapper/022:13:590
22636992323,0cyclictest0-21swapper/000:02:460
22636992323,0cyclictest0-21swapper/000:02:460
22636992321,1cyclictest28280-21ssh21:51:220
22636992321,1cyclictest0-21swapper/023:15:080
22636992321,1cyclictest0-21swapper/019:35:000
22636992319,2cyclictest1698-21apt22:59:430
2263699230,23cyclictest0-21swapper/023:49:180
2263699230,23cyclictest0-21swapper/023:14:350
2263699230,23cyclictest0-21swapper/022:05:060
2263699230,23cyclictest0-21swapper/021:57:050
2263699230,23cyclictest0-21swapper/021:44:330
2263699230,23cyclictest0-21swapper/021:35:150
2263699230,23cyclictest0-21swapper/000:09:410
2263699230,22cyclictest5575-21ssh22:00:100
2263699230,22cyclictest29226-21ssh00:25:270
2263699230,22cyclictest22670-21ntp_states00:19:520
2263699230,22cyclictest0-21swapper/023:08:250
2263699230,0cyclictest16748-21diskmemload23:23:180
2263699230,0cyclictest16748-21diskmemload21:11:190
2263699230,0cyclictest0-21swapper/022:22:510
2263699230,0cyclictest0-21swapper/022:18:150
2263699230,0cyclictest0-21swapper/000:22:550
22639992222,0cyclictest0-21swapper/322:56:383
22639992222,0cyclictest0-21swapper/322:52:573
22639992222,0cyclictest0-21swapper/322:11:023
22639992222,0cyclictest0-21swapper/322:05:553
22639992222,0cyclictest0-21swapper/322:00:073
22639992222,0cyclictest0-21swapper/300:26:013
22639992221,1cyclictest7643-21apt-get19:49:443
22639992220,1cyclictest0-21swapper/322:40:533
2263999220,22cyclictest4354-21sh00:33:553
2263999220,22cyclictest0-21swapper/322:20:223
2263999220,21cyclictest16748-21diskmemload21:30:153
2263999220,21cyclictest0-21swapper/323:55:063
2263999220,21cyclictest0-21swapper/322:25:503
2263999220,21cyclictest0-21swapper/321:56:283
2263999220,21cyclictest0-21swapper/321:28:383
2263999220,21cyclictest0-21swapper/320:04:453
2263999220,1cyclictest28447-21sh21:51:363
2263999220,1cyclictest0-21swapper/323:45:353
2263999220,0cyclictest17659-21apt-get23:14:433
22638992222,0cyclictest0-21swapper/222:57:302
22638992222,0cyclictest0-21swapper/222:25:372
22638992222,0cyclictest0-21swapper/200:05:082
22638992220,1cyclictest606-21dbus-daemon20:55:012
22638992220,1cyclictest5252-21apt-get19:44:442
22638992220,1cyclictest0-21swapper/221:25:412
2263899220,22cyclictest0-21swapper/220:09:432
2263899220,21cyclictest26227-21ssh22:50:302
2263899220,21cyclictest16748-21diskmemload21:55:132
2263899220,21cyclictest16748-21diskmemload21:35:082
2263899220,21cyclictest16748-21diskmemload21:10:052
2263899220,21cyclictest0-21swapper/222:30:072
2263899220,21cyclictest0-21swapper/221:41:252
2263899220,21cyclictest0-21swapper/221:20:292
2263899220,21cyclictest0-21swapper/221:04:452
22637992222,0cyclictest0-21swapper/123:36:331
22637992222,0cyclictest0-21swapper/123:34:571
22637992220,1cyclictest26257-21cron20:25:001
2263799220,21cyclictest16748-21diskmemload23:05:251
2263799220,21cyclictest16748-21diskmemload22:25:041
2263799220,21cyclictest10039-21apt-get19:54:441
2263799220,21cyclictest0-21swapper/123:20:541
2263799220,21cyclictest0-21swapper/121:36:101
2263799220,21cyclictest0-21swapper/120:09:431
2263799220,21cyclictest0-21swapper/119:34:441
2263799220,1cyclictest21565-21rm22:46:341
2263799220,1cyclictest15852-21ssh23:43:281
2263799220,1cyclictest0-21swapper/121:27:471
2263799220,0cyclictest0-21swapper/122:15:391
2263799220,0cyclictest0-21swapper/100:21:151
22636992222,0cyclictest0-21swapper/023:51:010
22636992222,0cyclictest0-21swapper/023:26:240
22636992222,0cyclictest0-21swapper/000:12:540
22636992221,1cyclictest1174-21ssh21:25:510
22636992221,0cyclictest26903-21apt-get20:25:020
22636992220,1cyclictest26300-21dpkg20:25:000
2263699220,22cyclictest16748-21diskmemload23:43:370
2263699220,22cyclictest0-21swapper/023:00:070
2263699220,21cyclictest26054-21ssh22:50:160
2263699220,21cyclictest22269-21sh21:15:060
2263699220,21cyclictest0-21swapper/019:59:440
2263699220,21cyclictest0-21swapper/019:59:440
2263699220,1cyclictest27401-21sh19:20:010
2263699220,1cyclictest23703-21ssh21:47:290
2263699220,1cyclictest0-21swapper/022:33:240
22639992119,1cyclictest2495-21apt-get20:44:423
22639992119,1cyclictest13930-21apt-get21:05:013
2263999210,20cyclictest0-21swapper/320:19:443
2263999210,20cyclictest0-21swapper/320:14:453
22638992121,0cyclictest16748-21diskmemload23:00:052
22638992120,1cyclictest0-21swapper/219:55:012
22638992119,1cyclictest313-21systemd-journal19:40:002
22638992119,1cyclictest12487-21apt-get19:59:442
22638992119,1cyclictest12487-21apt-get19:59:442
2263899210,20cyclictest0-21swapper/219:19:432
2263899210,1cyclictest27300-21apt-get20:29:432
2263799210,0cyclictest0-21swapper/119:59:441
2263799210,0cyclictest0-21swapper/119:59:441
22636992121,0cyclictest16748-21diskmemload21:20:430
22636992121,0cyclictest0-21swapper/020:49:440
22636992121,0cyclictest0-21swapper/020:49:440
22636992121,0cyclictest0-21swapper/019:44:440
22636992119,1cyclictest313-21systemd-journal20:40:000
2263699210,20cyclictest0-21swapper/020:34:450
2263699210,0cyclictest6642-21ssh21:31:100
2263999200,0cyclictest0-21swapper/321:09:443
22637992020,0cyclictest2495-21apt-get20:44:421
22637992020,0cyclictest0-21swapper/119:49:441
22637992018,1cyclictest4892-21apt-get20:49:441
22637992018,1cyclictest4892-21apt-get20:49:441
22637992018,1cyclictest26281-21apt-get20:25:021
2263799200,20cyclictest0-21swapper/120:14:451
2263799200,0cyclictest0-21swapper/120:54:441
22636992020,0cyclictest0-21swapper/021:10:000
22636992019,0cyclictest0-21swapper/019:49:440
2263699200,0cyclictest0-21swapper/020:59:440
22639991919,0cyclictest0-21swapper/320:39:443
22639991917,1cyclictest14278-21sendmail-msp20:00:013
22639991917,1cyclictest14278-21sendmail-msp20:00:013
22639991917,1cyclictest0-21swapper/320:49:443
22639991917,1cyclictest0-21swapper/320:49:443
22638991919,0cyclictest0-21swapper/221:09:442
22638991919,0cyclictest0-21swapper/219:14:432
22638991917,1cyclictest28049-21apt-get19:24:412
2263899190,0cyclictest0-21swapper/220:44:422
22637991919,0cyclictest0-21swapper/121:09:441
22637991919,0cyclictest0-21swapper/120:19:441
22637991919,0cyclictest0-21swapper/119:39:431
22637991919,0cyclictest0-21swapper/119:24:411
22637991917,1cyclictest25024-21awk19:15:011
2263799190,0cyclictest30096-21apt-get20:34:451
22636991919,0cyclictest7288-21apt-get20:54:440
22636991919,0cyclictest0-21swapper/020:44:420
22639991818,0cyclictest9682-21apt-get20:59:443
22639991818,0cyclictest0-21swapper/319:44:443
2263999180,18cyclictest0-21swapper/320:54:443
22638991818,0cyclictest0-21swapper/220:39:442
22638991818,0cyclictest0-21swapper/219:49:442
22638991817,0cyclictest0-21swapper/220:49:442
22638991817,0cyclictest0-21swapper/220:49:442
22638991816,1cyclictest0-21swapper/220:20:002
22636991818,0cyclictest22088-21apt-get20:19:440
22639991717,0cyclictest29063-21apt-get20:30:023
22639991716,0cyclictest0-21swapper/320:24:443
2263999170,16cyclictest0-21swapper/319:17:303
22638991717,0cyclictest0-21swapper/220:04:452
22636991717,0cyclictest2831-21apt-get19:39:430
22636991717,0cyclictest0-21swapper/019:24:410
22636991717,0cyclictest0-21swapper/019:14:430
22636991715,1cyclictest16659-21awk20:05:010
22639991616,0cyclictest0-21swapper/319:39:433
22639991614,1cyclictest30450-21apt-get19:29:443
22638991613,0cyclictest0-21swapper/219:25:072
22637991613,3cyclictest0-21swapper/120:00:121
22636991616,0cyclictest0-21swapper/021:04:440
22636991616,0cyclictest0-21swapper/020:09:430
22638991515,0cyclictest0-21swapper/219:34:442
22637991515,0cyclictest0-21swapper/121:04:451
2263799150,5cyclictest313-21systemd-journal21:00:011
22636991515,0cyclictest0-21swapper/019:54:440
2263999140,14cyclictest0-21swapper/319:50:503
2263999140,14cyclictest0-21swapper/319:22:053
2263999140,14cyclictest0-21swapper/319:10:473
2263999140,0cyclictest0-21swapper/319:31:413
2263899140,14cyclictest0-21swapper/220:56:542
2263899140,14cyclictest0-21swapper/220:31:522
2263899140,14cyclictest0-21swapper/220:20:092
2263899140,14cyclictest0-21swapper/220:10:022
2263699140,14cyclictest0-21swapper/019:25:150
2263699140,0cyclictest0-21swapper/020:10:380
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional