You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-02 - 08:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Wed Sep 02, 2026 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2632099270,26cyclictest6869-21awk00:20:011
26323992522,2cyclictest21586-21idleruntime-cro21:40:003
2632399250,24cyclictest0-21swapper/320:26:153
26322992523,1cyclictest31226-21ssh21:47:372
2632299250,2cyclictest3215-21ssh21:51:252
2632299250,24cyclictest22277-21ssh23:36:052
26320992523,1cyclictest12133-21sh22:28:351
26316992523,1cyclictest0-21swapper/023:34:170
2631699250,24cyclictest19939-21diskmemload23:57:540
2631699250,24cyclictest19939-21diskmemload23:20:460
2631699250,24cyclictest19939-21diskmemload23:20:460
2631699250,24cyclictest0-21swapper/023:42:170
26323992422,1cyclictest14703-21users22:01:263
2632399242,1cyclictest11084-21cron19:45:003
2632399240,23cyclictest6143-21munin-plugin-st21:55:013
2632399240,23cyclictest0-21swapper/323:11:143
2632399240,23cyclictest0-21swapper/323:07:193
2632399240,23cyclictest0-21swapper/321:59:523
26322992424,0cyclictest0-21swapper/221:31:182
26322992423,0cyclictest19939-21diskmemload00:33:572
26322992422,1cyclictest0-21swapper/223:45:032
2632299241,22cyclictest11890-21rm22:00:042
2632299240,24cyclictest0-21swapper/222:27:072
2632299240,23cyclictest3002-21taskset23:18:112
2632299240,23cyclictest24413-21perf22:40:012
2632299240,1cyclictest0-21swapper/221:16:092
26320992423,1cyclictest19939-21diskmemload00:27:381
26320992422,1cyclictest0-21swapper/122:55:391
2632099241,1cyclictest25271-21sh23:37:481
2632099240,24cyclictest0-21swapper/123:21:411
2632099240,24cyclictest0-21swapper/123:21:411
2632099240,24cyclictest0-21swapper/122:44:141
2632099240,23cyclictest0-21swapper/123:43:521
2632099240,23cyclictest0-21swapper/121:10:321
26316992424,0cyclictest0-21swapper/000:23:580
26316992423,1cyclictest19939-21diskmemload23:02:290
26316992421,2cyclictest0-21swapper/000:10:240
2631699240,24cyclictest0-21swapper/023:19:470
2631699240,24cyclictest0-21swapper/000:35:580
2631699240,24cyclictest0-21swapper/000:26:560
2631699240,24cyclictest0-21swapper/000:09:560
2631699240,23cyclictest0-21swapper/023:12:220
2631699240,0cyclictest0-21swapper/022:53:260
2631699240,0cyclictest0-21swapper/000:31:100
26323992323,0cyclictest19939-21diskmemload22:56:583
26323992323,0cyclictest0-21swapper/323:35:343
26323992323,0cyclictest0-21swapper/322:26:433
26323992322,1cyclictest19939-21diskmemload21:12:143
26323992322,1cyclictest0-21swapper/322:47:013
26323992321,1cyclictest0-21swapper/323:16:193
26323992320,2cyclictest19434-21ssh22:35:363
26323992320,2cyclictest17557-21basename21:05:013
26323992320,2cyclictest16611-21ssh22:32:023
2632399230,23cyclictest0-21swapper/322:06:413
2632399230,23cyclictest0-21swapper/300:30:113
2632399230,23cyclictest0-21swapper/300:02:183
2632399230,22cyclictest4227-21/usr/sbin/munin22:51:163
2632399230,22cyclictest4222-21rm21:23:583
2632399230,22cyclictest3090-21ssh22:21:133
2632399230,22cyclictest28019-21ssh22:42:193
2632399230,22cyclictest19939-21diskmemload23:42:453
2632399230,22cyclictest12595-21ssh00:25:013
2632399230,22cyclictest0-21swapper/323:45:183
2632399230,0cyclictest0-21swapper/322:20:003
2632399230,0cyclictest0-21swapper/321:27:353
2632399230,0cyclictest0-21swapper/300:36:213
2632399230,0cyclictest0-21swapper/300:17:493
26322992323,0cyclictest23412-21ssh23:07:082
26322992323,0cyclictest0-21swapper/221:21:092
26322992321,2cyclictest0-21swapper/223:03:492
26322992321,1cyclictest6152-21ssh23:50:172
26322992321,1cyclictest28709-21apt-get19:15:002
26322992320,2cyclictest29518-21ssh00:39:592
26322992320,2cyclictest28162-21ssh23:11:232
26322992320,2cyclictest25125-21ssh21:42:072
26322992320,2cyclictest13772-21ssh23:27:302
26322992319,3cyclictest16467-21ssh21:35:102
2632299230,2cyclictest313-21systemd-journal21:05:012
2632299230,23cyclictest0-21swapper/200:23:152
2632299230,23cyclictest0-21swapper/200:13:402
2632299230,22cyclictest8993-21sh22:55:012
2632299230,22cyclictest8763-21latency_hist22:55:002
2632299230,22cyclictest7877-21ssh23:22:022
2632299230,22cyclictest7877-21ssh23:22:022
2632299230,22cyclictest30623-21ssh22:45:342
2632299230,22cyclictest18303-21idleruntime-cro20:00:002
2632299230,22cyclictest17924-21ssh00:29:262
2632299230,22cyclictest14866-21ssh23:57:252
2632299230,22cyclictest11258-21ssh21:59:292
2632299230,0cyclictest0-21swapper/223:40:582
2632299230,0cyclictest0-21swapper/222:16:152
26320992323,0cyclictest19939-21diskmemload00:35:591
26320992323,0cyclictest0-21swapper/123:32:101
26320992323,0cyclictest0-21swapper/122:46:151
26320992323,0cyclictest0-21swapper/122:11:251
26320992321,1cyclictest18020-21rm22:05:411
26320992321,1cyclictest11946-21diskmemload22:00:081
26320992321,1cyclictest0-21swapper/121:52:551
26320992321,1cyclictest0-21swapper/100:22:511
26320992321,1cyclictest0-21swapper/100:00:291
26320992320,2cyclictest27395-21wc21:16:131
2632099230,23cyclictest0-21swapper/122:20:151
2632099230,23cyclictest0-21swapper/121:45:161
2632099230,23cyclictest0-21swapper/100:31:431
2632099230,22cyclictest6930-21sh22:52:271
2632099230,22cyclictest26522-21ssh23:10:591
2632099230,22cyclictest14550-21sh23:28:361
2632099230,22cyclictest13547-21sh22:30:111
2632099230,22cyclictest0-21swapper/123:45:131
2632099230,22cyclictest0-21swapper/121:58:091
2632099230,22cyclictest0-21swapper/121:26:561
2632099230,1cyclictest23366-21kworker/u8:223:09:191
2632099230,1cyclictest19939-21diskmemload23:54:391
2632099230,0cyclictest19939-21diskmemload00:05:571
2632099230,0cyclictest0-21swapper/123:15:551
26316992323,0cyclictest5946-21ssh21:54:490
26316992323,0cyclictest19939-21diskmemload21:30:050
26316992323,0cyclictest0-21swapper/021:16:150
26316992321,1cyclictest0-21swapper/022:01:170
2631699230,23cyclictest0-21swapper/022:12:410
2631699230,23cyclictest0-21swapper/021:49:360
2631699230,23cyclictest0-21swapper/021:41:370
2631699230,22cyclictest22435-21ssh22:37:280
2631699230,22cyclictest11251-21ptp4l-jitter22:56:220
2631699230,22cyclictest0-21swapper/023:36:120
2631699230,22cyclictest0-21swapper/022:15:510
2631699230,1cyclictest0-21swapper/000:19:080
2631699230,0cyclictest19939-21diskmemload23:53:390
2631699230,0cyclictest19939-21diskmemload21:35:580
2631699230,0cyclictest19939-21diskmemload21:24:480
2631699230,0cyclictest0-21swapper/023:05:540
26323992222,0cyclictest19939-21diskmemload23:29:073
26323992222,0cyclictest19939-21diskmemload00:10:343
26323992222,0cyclictest0-21swapper/323:00:183
26323992222,0cyclictest0-21swapper/321:44:483
26323992221,1cyclictest19939-21diskmemload23:22:053
26323992221,1cyclictest19939-21diskmemload23:22:053
26323992220,1cyclictest8314-21apt-get20:46:153
26323992220,1cyclictest606-21dbus-daemon19:50:003
26323992220,1cyclictest4252-21apt-get19:31:133
26323992220,1cyclictest28728-21dpkg19:15:003
26323992220,1cyclictest0-21swapper/323:56:123
2632399220,22cyclictest0-21swapper/300:20:563
2632399220,21cyclictest6319-21ssh23:50:413
2632399220,21cyclictest0-21swapper/321:46:063
2632399220,21cyclictest0-21swapper/321:32:163
2632399220,1cyclictest19939-21diskmemload21:15:103
2632399220,1cyclictest0-21swapper/323:34:033
2632399220,1cyclictest0-21swapper/300:05:303
26322992222,0cyclictest0-21swapper/221:11:032
26322992220,2cyclictest7980-21idleruntime-cro20:45:002
26322992220,1cyclictest26969-21sh00:08:312
26322992220,1cyclictest0-21swapper/222:31:232
26322992220,1cyclictest0-21swapper/220:11:132
26322992220,1cyclictest0-21swapper/220:11:132
2632299220,21cyclictest27453-21ssh22:41:312
2632299220,21cyclictest19939-21diskmemload00:00:282
2632299220,21cyclictest0-21swapper/223:30:052
2632299220,21cyclictest0-21swapper/221:26:032
2632299220,1cyclictest17811-21ssh22:05:252
2632299220,1cyclictest0-21swapper/222:11:472
26320992222,0cyclictest0-21swapper/122:15:411
26320992221,1cyclictest0-21swapper/121:22:331
26320992220,1cyclictest23456-21apt-get20:11:131
26320992220,1cyclictest23456-21apt-get20:11:131
26320992220,1cyclictest16840-21perf00:00:001
26320992220,1cyclictest15072-21ssh23:00:371
26320992220,1cyclictest0-21swapper/119:45:001
2632099220,21cyclictest13855-21apt-get19:51:131
2632099220,21cyclictest0-21swapper/122:35:061
2632099220,21cyclictest0-21swapper/120:56:131
2632099220,21cyclictest0-21swapper/119:36:151
2632099220,1cyclictest25851-21apt-get20:16:151
2632099220,1cyclictest0-21swapper/121:35:331
26316992222,0cyclictest0-21swapper/023:46:360
26316992222,0cyclictest0-21swapper/021:25:500
26316992221,1cyclictest0-21swapper/022:25:210
26316992220,1cyclictest11459-21apt-get19:46:130
26316992219,2cyclictest32760-21apt-get20:30:010
2631699221,21cyclictest62550irq/127-eno122:46:150
2631699220,21cyclictest19939-21diskmemload23:25:090
2631699220,21cyclictest17360-21ssh00:00:260
2631699220,21cyclictest0-21swapper/022:41:420
2631699220,21cyclictest0-21swapper/022:30:010
2631699220,1cyclictest6650-21ssh22:23:470
2631699220,1cyclictest28709-21apt-get19:15:020
2631699220,1cyclictest0-21swapper/022:07:110
2631699220,0cyclictest19939-21diskmemload21:55:210
26323992120,1cyclictest6651-21apt-get19:36:153
26323992120,1cyclictest19939-21diskmemload22:10:283
2632399210,21cyclictest0-21swapper/320:36:163
26322992121,0cyclictest0-21swapper/200:15:062
2632299210,20cyclictest1093-21apt-get20:31:152
2632299210,20cyclictest0-21swapper/220:36:162
2632299210,0cyclictest28332-21apt-get20:21:142
2632099210,0cyclictest0-21swapper/119:11:121
26316992121,0cyclictest0-21swapper/020:21:150
26316992120,1cyclictest5916-21apt-get20:41:130
2631699210,20cyclictest9067-21apt-get19:41:140
2631699210,0cyclictest0-21swapper/019:51:130
26323992020,0cyclictest0-21swapper/320:30:023
26323992020,0cyclictest0-21swapper/320:21:153
26323992020,0cyclictest0-21swapper/319:56:143
26323992020,0cyclictest0-21swapper/319:21:153
2632399200,0cyclictest0-21swapper/320:06:143
26322992019,0cyclictest31875-21apt-get19:21:152
26322992018,1cyclictest6311-21latency_hist19:35:012
2632299200,0cyclictest0-21swapper/220:26:152
26320992020,0cyclictest18671-21apt-get20:01:171
26320992020,0cyclictest0-21swapper/120:31:151
26316992020,0cyclictest0-21swapper/020:56:140
26316992019,1cyclictest0-21swapper/020:36:160
26316992018,1cyclictest1507-21apt19:25:010
2631699200,0cyclictest0-21swapper/020:11:130
2631699200,0cyclictest0-21swapper/020:11:130
26323991919,0cyclictest0-21swapper/320:41:133
26323991919,0cyclictest0-21swapper/320:16:153
26323991919,0cyclictest0-21swapper/319:16:153
26320991919,0cyclictest0-21swapper/120:46:151
26320991918,1cyclictest3502-21apt-get20:36:161
2632099190,0cyclictest1499-21perf19:25:011
26316991919,0cyclictest0-21swapper/020:31:150
26316991918,0cyclictest0-21swapper/019:31:130
2631699190,18cyclictest27996-21awk20:20:010
26323991817,1cyclictest10706-21apt-get20:51:153
26320991818,0cyclictest0-21swapper/119:15:021
26316991818,0cyclictest0-21swapper/021:06:140
26316991816,1cyclictest0-21swapper/020:50:000
26316991816,1cyclictest0-21swapper/019:36:190
26323991717,0cyclictest0-21swapper/320:11:133
26323991717,0cyclictest0-21swapper/320:11:133
26322991717,0cyclictest0-21swapper/220:46:152
26322991717,0cyclictest0-21swapper/219:45:002
26322991715,1cyclictest0-21swapper/220:01:272
26322991714,2cyclictest16090-21munin-plugin-st19:55:002
26320991717,0cyclictest0-21swapper/120:26:151
26320991717,0cyclictest0-21swapper/119:46:131
26320991716,1cyclictest6307-21turbostat.cron19:35:011
26320991716,0cyclictest0-21swapper/120:51:151
26316991717,0cyclictest0-21swapper/019:26:140
2631699170,0cyclictest0-21swapper/019:56:140
2632399160,15cyclictest3905-21perf19:30:013
2632299169,6cyclictest610-21wpa_supplicant19:28:502
26322991616,0cyclictest0-21swapper/220:16:152
26322991614,1cyclictest0-21swapper/219:40:012
2632099160,0cyclictest16250-21apt-get19:56:141
2632099160,0cyclictest0-21swapper/121:06:141
2632399150,1cyclictest13905-21irqstats20:56:173
2632299150,14cyclictest0-21swapper/220:55:442
26316991515,0cyclictest0-21swapper/020:51:150
2632399140,0cyclictest0-21swapper/321:05:133
2632399140,0cyclictest0-21swapper/320:00:113
2632399140,0cyclictest0-21swapper/319:50:223
26322991414,0cyclictest0-21swapper/221:05:102
26322991414,0cyclictest0-21swapper/220:05:292
26322991414,0cyclictest0-21swapper/219:46:132
2632299140,14cyclictest0-21swapper/220:50:082
2632299140,0cyclictest0-21swapper/219:15:162
2632099140,14cyclictest0-21swapper/120:40:111
2632099140,14cyclictest0-21swapper/120:05:201
2632099140,14cyclictest0-21swapper/119:25:191
2632099140,0cyclictest0-21swapper/121:00:041
2632099140,0cyclictest0-21swapper/120:20:041
2631699140,14cyclictest0-21swapper/020:05:140
2631699140,14cyclictest0-21swapper/020:00:070
2631699140,14cyclictest0-21swapper/019:10:330
2631699140,0cyclictest0-21swapper/021:00:090
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional