You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-03 - 07:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Thu Sep 03, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16497992525,0cyclictest0-21swapper/322:09:483
16497992523,1cyclictest0-21swapper/321:16:213
16492992523,0cyclictest0-21swapper/222:25:542
1649299250,24cyclictest10524-21diskmemload23:58:062
1649299250,24cyclictest10524-21diskmemload22:03:162
16491992523,2cyclictest16728-21ssh23:36:351
16491992523,1cyclictest0-21swapper/100:26:231
1649199250,24cyclictest32414-21grep22:26:191
1649099250,1cyclictest29251-21apt-get19:36:180
1649799240,24cyclictest0-21swapper/300:03:243
1649799240,23cyclictest0-21swapper/322:36:393
1649799240,23cyclictest0-21swapper/300:20:493
1649799240,1cyclictest10524-21diskmemload23:49:333
16492992422,1cyclictest0-21swapper/222:13:052
1649299240,24cyclictest10524-21diskmemload23:18:432
1649299240,24cyclictest0-21swapper/222:33:112
1649299240,23cyclictest10524-21diskmemload21:21:342
1649299240,23cyclictest0-21swapper/223:26:212
1649299240,1cyclictest10524-21diskmemload23:12:482
1649299240,1cyclictest10524-21diskmemload22:23:542
1649299240,1cyclictest0-21swapper/223:46:022
16491992424,0cyclictest0-21swapper/122:54:561
16491992423,1cyclictest0-21swapper/121:48:521
16491992421,2cyclictest12109-21apt-get23:05:011
1649199240,24cyclictest0-21swapper/123:00:071
1649199240,0cyclictest10524-21diskmemload22:11:381
16490992424,0cyclictest0-21swapper/000:23:350
16490992422,2cyclictest0-21swapper/021:48:520
1649099242,1cyclictest62550irq/127-eno123:26:310
1649099240,24cyclictest0-21swapper/022:59:340
1649099240,24cyclictest0-21swapper/022:52:400
1649099240,23cyclictest3559-21apt-get20:55:020
1649099240,23cyclictest0-21swapper/022:35:070
1649099240,23cyclictest0-21swapper/021:25:370
16497992323,0cyclictest0-21swapper/323:21:483
16497992323,0cyclictest0-21swapper/322:10:103
16497992323,0cyclictest0-21swapper/321:35:333
16497992321,1cyclictest8862-21apt-get20:01:193
16497992321,1cyclictest0-21swapper/322:31:233
16497992320,2cyclictest606-21dbus-daemon19:30:013
16497992320,2cyclictest24655-21idleruntime21:21:233
16497992320,2cyclictest21241-21munin-run22:45:013
16497992320,2cyclictest21241-21munin-run22:45:013
1649799231,21cyclictest0-21swapper/323:40:353
1649799230,23cyclictest0-21swapper/323:03:593
1649799230,23cyclictest0-21swapper/321:53:143
1649799230,23cyclictest0-21swapper/321:49:103
1649799230,23cyclictest0-21swapper/321:26:223
1649799230,23cyclictest0-21swapper/300:15:283
1649799230,22cyclictest0-21swapper/323:55:003
1649799230,22cyclictest0-21swapper/322:00:493
1649799230,0cyclictest10524-21diskmemload23:56:433
1649799230,0cyclictest10524-21diskmemload00:09:183
1649799230,0cyclictest0-21swapper/323:13:103
1649799230,0cyclictest0-21swapper/321:41:093
1649799230,0cyclictest0-21swapper/321:11:063
1649799230,0cyclictest0-21swapper/320:06:183
16492992323,0cyclictest0-21swapper/223:50:302
16492992323,0cyclictest0-21swapper/221:17:382
16492992321,1cyclictest0-21swapper/200:36:212
16492992319,0cyclictest0-21swapper/223:30:502
1649299230,2cyclictest4468-21sshd22:57:242
1649299230,23cyclictest0-21swapper/222:36:352
1649299230,22cyclictest26105-21apt-get20:36:182
1649299230,22cyclictest25062-21dump-pmu-power23:45:012
1649299230,22cyclictest17599-21ssh23:37:362
1649299230,22cyclictest14556-21ssh00:32:142
1649299230,22cyclictest10524-21diskmemload21:10:342
1649299230,22cyclictest0-21swapper/221:57:292
1649299230,0cyclictest0-21swapper/223:00:022
1649299230,0cyclictest0-21swapper/221:50:562
1649299230,0cyclictest0-21swapper/200:25:112
1649299230,0cyclictest0-21swapper/200:06:172
16491992323,0cyclictest10524-21diskmemload22:06:091
16491992323,0cyclictest10524-21diskmemload21:25:281
16491992323,0cyclictest0-21swapper/123:50:231
16491992323,0cyclictest0-21swapper/123:34:591
16491992323,0cyclictest0-21swapper/122:03:551
16491992323,0cyclictest0-21swapper/121:35:181
16491992323,0cyclictest0-21swapper/121:20:171
16491992321,1cyclictest26210-21ssh22:48:391
16491992321,1cyclictest0-21swapper/121:55:371
16491992320,2cyclictest313-21systemd-journal00:10:001
1649199230,23cyclictest0-21swapper/123:21:251
1649199230,23cyclictest0-21swapper/122:58:581
1649199230,23cyclictest0-21swapper/122:34:061
1649199230,22cyclictest7579-21sh23:57:201
1649199230,22cyclictest754-21sh00:21:171
1649199230,22cyclictest5165-21ssh23:26:291
1649199230,22cyclictest31738-21sh00:19:291
1649199230,22cyclictest24340-21ssh23:44:081
1649199230,22cyclictest21315-21ssh00:10:251
1649199230,22cyclictest14101-21ssh00:31:391
1649199230,22cyclictest0-21swapper/121:10:101
1649199230,0cyclictest0-21swapper/123:15:411
1649199230,0cyclictest0-21swapper/121:34:191
16490992323,0cyclictest10524-21diskmemload21:24:550
16490992323,0cyclictest0-21swapper/023:42:310
16490992323,0cyclictest0-21swapper/000:38:200
16490992322,1cyclictest0-21swapper/023:12:080
16490992322,1cyclictest0-21swapper/000:18:540
16490992321,2cyclictest30086-21ssh21:55:130
16490992321,1cyclictest5072-21apt-get23:56:200
16490992321,1cyclictest18176-21munin-run20:20:010
16490992321,1cyclictest0-21swapper/023:31:200
16490992321,1cyclictest0-21swapper/022:11:190
1649099232,0cyclictest62550irq/127-eno123:22:410
16490992320,2cyclictest20571-21latency_hist20:25:010
16490992320,2cyclictest14183-21runrttasks00:31:460
1649099230,23cyclictest0-21swapper/023:50:340
1649099230,23cyclictest0-21swapper/022:30:060
1649099230,22cyclictest9586-21ssh22:06:110
1649099230,22cyclictest7633-21ssh21:35:130
1649099230,22cyclictest10524-21diskmemload23:06:120
1649099230,22cyclictest10524-21diskmemload22:01:130
1649099230,1cyclictest12222-21apt-config23:05:000
1649099230,1cyclictest10524-21diskmemload00:05:190
1649099230,0cyclictest10524-21diskmemload23:45:030
1649099230,0cyclictest10524-21diskmemload21:16:180
1649099230,0cyclictest0-21swapper/022:42:170
1649099230,0cyclictest0-21swapper/022:42:170
1649099230,0cyclictest0-21swapper/022:26:190
1649099230,0cyclictest0-21swapper/000:10:530
16497992222,0cyclictest0-21swapper/319:51:213
16497992222,0cyclictest0-21swapper/300:30:173
16497992222,0cyclictest0-21swapper/300:11:063
16497992221,1cyclictest0-21swapper/323:16:123
16497992221,1cyclictest0-21swapper/322:50:353
16497992221,1cyclictest0-21swapper/322:25:053
16497992220,1cyclictest0-21swapper/322:45:023
16497992219,2cyclictest622-21gdbus21:10:013
1649799221,1cyclictest0-21swapper/323:30:403
1649799220,21cyclictest10524-21diskmemload23:05:363
1649799220,21cyclictest0-21swapper/323:26:313
1649799220,21cyclictest0-21swapper/321:30:233
1649799220,21cyclictest0-21swapper/320:21:183
1649799220,21cyclictest0-21swapper/319:56:193
1649799220,21cyclictest0-21swapper/319:46:193
1649799220,21cyclictest0-21swapper/300:36:443
1649799220,1cyclictest0-21swapper/322:22:373
1649799220,1cyclictest0-21swapper/300:26:183
1649799220,0cyclictest10524-21diskmemload23:37:383
1649799220,0cyclictest10524-21diskmemload22:16:083
16492992222,0cyclictest0-21swapper/223:20:152
16492992222,0cyclictest0-21swapper/222:40:342
16492992222,0cyclictest0-21swapper/222:40:342
16492992222,0cyclictest0-21swapper/221:45:542
16492992222,0cyclictest0-21swapper/221:30:032
16492992220,1cyclictest10524-21diskmemload21:26:262
16492992220,1cyclictest0-21swapper/222:46:202
16492992219,2cyclictest7736-21rm21:35:222
16492992218,3cyclictest0-21swapper/200:15:212
1649299220,21cyclictest5762-21perf21:00:002
1649299220,21cyclictest21154-21apt-get22:16:232
1649299220,21cyclictest10524-21diskmemload00:11:052
1649299220,1cyclictest886-21apt-get20:51:182
1649299220,1cyclictest30916-21apt-get20:46:192
1649299220,1cyclictest18148-21turbostat20:20:012
1649299220,1cyclictest0-21swapper/200:20:212
1649299220,0cyclictest0-21swapper/200:00:312
16491992222,0cyclictest10524-21diskmemload21:53:181
16491992222,0cyclictest0-21swapper/122:35:391
16491992222,0cyclictest0-21swapper/121:41:291
16491992220,1cyclictest25706-21ssh22:20:011
16491992220,1cyclictest17536-21ssh00:35:551
16491992220,1cyclictest0-21swapper/120:55:001
1649199220,2cyclictest31300-21sh19:40:011
1649199220,22cyclictest19191-21ssh22:42:131
1649199220,22cyclictest19191-21ssh22:42:131
1649199220,21cyclictest21070-21ssh22:16:201
1649199220,21cyclictest15678-21awk20:15:001
1649199220,21cyclictest10357-21ssh00:00:431
1649199220,21cyclictest0-21swapper/120:55:021
1649199220,21cyclictest0-21swapper/120:31:171
1649199220,1cyclictest28551-21ssh23:47:041
1649199220,1cyclictest21685-21ssh21:18:311
1649199220,1cyclictest19285-21ssh23:11:121
16490992222,0cyclictest10524-21diskmemload22:17:190
16490992221,1cyclictest14374-21ssh23:35:380
16490992221,0cyclictest0-21swapper/019:46:190
16490992220,2cyclictest10782-21ssh21:10:020
16490992220,1cyclictest0-21swapper/021:50:150
16490992220,1cyclictest0-21swapper/000:26:340
1649099220,22cyclictest10524-21diskmemload22:22:100
1649099220,21cyclictest26517-21idleruntime-cro19:30:010
1649099220,21cyclictest10524-21diskmemload21:40:140
1649099220,21cyclictest0-21swapper/021:30:010
1649099220,1cyclictest24006-21ssh23:15:080
1649099220,1cyclictest0-21swapper/000:02:200
1649099220,0cyclictest0-21swapper/022:46:040
16497992119,1cyclictest24097-21cron19:25:003
1649799210,21cyclictest0-21swapper/322:55:063
1649799210,21cyclictest0-21swapper/320:30:023
1649799210,20cyclictest0-21swapper/321:55:363
1649799210,20cyclictest0-21swapper/320:46:193
1649799210,20cyclictest0-21swapper/320:26:183
1649799210,1cyclictest19647-21apt-get19:16:193
16492992120,0cyclictest0-21swapper/220:11:232
16492992119,1cyclictest6444-21apt-get19:56:192
16492992119,1cyclictest18897-21latency_hist19:15:002
1649299210,21cyclictest0-21swapper/223:05:472
1649299210,21cyclictest0-21swapper/222:05:032
1649299210,20cyclictest0-21swapper/222:50:112
1649299210,1cyclictest30572-21perf20:45:002
16491992119,1cyclictest468-21cron20:50:001
1649199210,21cyclictest20917-21apt-get20:26:181
1649199210,0cyclictest0-21swapper/119:16:191
16490992121,0cyclictest0-21swapper/021:01:170
16490992121,0cyclictest0-21swapper/020:46:190
16490992120,0cyclictest0-21swapper/019:41:190
16490992119,1cyclictest0-21swapper/020:40:000
1649099210,20cyclictest0-21swapper/020:31:170
1649099210,0cyclictest0-21swapper/021:06:190
16497992020,0cyclictest0-21swapper/321:01:173
16497992020,0cyclictest0-21swapper/320:36:183
16497992020,0cyclictest0-21swapper/320:11:233
1649799200,19cyclictest0-21swapper/320:56:193
1649799200,0cyclictest0-21swapper/319:41:183
16492992020,0cyclictest31669-21apt-get19:41:182
16492992020,0cyclictest0-21swapper/220:31:172
16491992020,0cyclictest0-21swapper/119:46:191
16491992020,0cyclictest0-21swapper/119:11:191
16491992018,1cyclictest0-21swapper/120:10:001
1649199200,0cyclictest0-21swapper/121:06:191
16490992020,0cyclictest0-21swapper/020:01:190
16490992020,0cyclictest0-21swapper/019:56:190
16490992020,0cyclictest0-21swapper/019:21:180
16490992017,2cyclictest28884-21sh19:35:010
1649099200,19cyclictest13655-21apt-get20:11:230
16497991919,0cyclictest0-21swapper/320:51:183
16492991919,0cyclictest0-21swapper/219:55:002
16492991918,1cyclictest22955-21idleruntime-cro20:30:012
16492991918,1cyclictest11255-21apt-get20:06:182
16492991917,1cyclictest26495-21wc19:30:012
16492991917,1cyclictest0-21swapper/220:01:192
16492991916,2cyclictest3676-21cron19:50:002
16490991919,0cyclictest0-21swapper/019:11:190
16497991818,0cyclictest26856-21apt-get19:31:183
16497991818,0cyclictest0-21swapper/319:36:183
16491991816,1cyclictest28135-21systemctl20:40:001
16491991815,2cyclictest8145-21latency_hist21:05:001
1649199180,18cyclictest0-21swapper/119:56:191
1649099180,17cyclictest11255-21apt-get20:06:180
16497991717,0cyclictest0-21swapper/319:11:193
16492991716,1cyclictest0-21swapper/219:16:192
16492991715,1cyclictest24097-21sh19:25:002
16491991717,0cyclictest0-21swapper/119:41:191
16491991717,0cyclictest0-21swapper/119:31:191
16490991717,0cyclictest0-21swapper/020:41:190
1649299160,0cyclictest0-21swapper/219:36:182
16491991615,1cyclictest28523-21apt-get20:41:191
16491991614,1cyclictest8862-21apt-get20:01:191
1649099167,8cyclictest13-21ksoftirqd/019:20:000
16490991615,0cyclictest4049-21apt-get19:51:210
16491991515,0cyclictest18524-21apt-get20:21:181
1649199150,1cyclictest24430-21find19:26:181
1649199150,1cyclictest0-21swapper/120:19:191
1649199150,13cyclictest622-21gdbus19:21:251
16490991513,1cyclictest886-21apt-get20:51:180
1649799140,14cyclictest0-21swapper/320:41:163
1649799140,14cyclictest0-21swapper/320:16:403
16492991414,0cyclictest0-21swapper/221:00:012
16492991414,0cyclictest0-21swapper/219:30:352
1649299140,14cyclictest0-21swapper/220:20:542
1649199140,0cyclictest0-21swapper/119:50:181
1649099140,14cyclictest0-21swapper/020:25:350
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional