You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-06 - 09:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Sun Sep 06, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
416421030,1sleep50-21swapper/522:12:245
292762880,1sleep50-21swapper/521:31:515
29351992218,3cyclictest4325-21turbostat21:55:004
2934299191,11cyclictest103-1kworker/0:1H+kblockd22:10:330
2934299184,10cyclictest7003-21ssh21:37:430
2934299180,14cyclictest15043-21sh21:24:200
2934299180,10cyclictest774-21runrttasks21:47:290
2934299180,10cyclictest4506-21sh21:18:070
2934299180,10cyclictest4506-21sh21:18:070
2934299180,10cyclictest27502-21diskmemload00:34:310
2934299180,10cyclictest21766-21ssh23:54:270
2934799179,6cyclictest27798-21grep23:20:251
2934299173,12cyclictest30409-21sh00:17:240
2934299172,8cyclictest31144-21sh23:22:360
2934299171,12cyclictest23204-21sh00:13:330
29342991710,6cyclictest25701-21wc23:20:000
2934299170,9cyclictest8159-21sh00:23:240
2934299170,9cyclictest774-21runrttasks21:29:540
2934299170,9cyclictest29767-21sh21:32:120
2934299170,14cyclictest30900-21sh22:27:370
2934299170,14cyclictest2056-21sh21:53:250
2934299170,14cyclictest10102-21sh21:57:490
162552170,3sleep50-21swapper/500:09:515
2935099164,8cyclictest29056-21mailstats20:15:213
2934999163,9cyclictest700-21gdbus21:35:212
29349991613,2cyclictest31012-21latency_hist22:10:002
2934799168,6cyclictest26339-21sort00:15:141
2934299164,4cyclictest0-21swapper/021:10:180
2934299163,6cyclictest156011needreboot20:55:170
2934299163,11cyclictest11342-21sh22:53:010
2934299162,10cyclictest21060-21runrttasks21:07:500
2934299161,6cyclictest1178-21taskset23:42:120
2935199154,8cyclictest1470-21ntpq20:25:214
2935199150,12cyclictest31273-21sh22:27:534
2935099158,5cyclictest16482-21ssh22:00:493
29350991511,3cyclictest27364-21needreboot23:20:183
2934999155,8cyclictest9536-21/usr/sbin/munin23:10:172
2934999155,8cyclictest9536-21/usr/sbin/munin23:10:172
2934999153,8cyclictest30804-21apt-key21:15:012
2934999153,8cyclictest30804-21apt-key21:15:012
2934999151,10cyclictest29187-21/usr/sbin/munin23:40:112
2934999151,10cyclictest1535-21diskmemload23:24:402
2934999150,9cyclictest31379-21sh21:33:232
2934799153,9cyclictest751-21postgres20:47:471
2934799152,9cyclictest9387-21seq20:41:001
2934799151,10cyclictest29611-21/usr/sbin/munin19:10:211
2934799150,11cyclictest16182-21wc21:25:011
2934299156,7cyclictest20604-21chrt22:21:320
2934299154,9cyclictest683-21dbus-daemon22:00:000
2934299153,9cyclictest25291-21sed23:00:250
2934299153,6cyclictest8228-21ssh00:05:110
2934299153,6cyclictest16018-21ssh21:42:490
2934299153,5cyclictest9959-21which23:10:210
2934299153,5cyclictest9959-21which23:10:200
2934299153,10cyclictest7654-21ssh23:45:320
2934299153,10cyclictest13478-21sh00:25:390
2934299152,9cyclictest25682-21sh23:55:550
2934299152,9cyclictest25682-21sh23:55:550
2934299152,8cyclictest4837-21sh23:25:370
2934299151,10cyclictest4555-21sh00:02:400
2934299151,10cyclictest24723-21diskmemload22:05:260
29342991510,4cyclictest9437-21cut22:15:180
2934299150,8cyclictest13100-21runrttasks19:40:400
2935199143,8cyclictest5845-21latency21:55:184
2935199143,8cyclictest27077-21timerandwakeup21:30:294
2935199141,9cyclictest4546-21ssh22:30:354
2935199141,9cyclictest29929-21sh23:59:024
2935199141,9cyclictest29929-21sh23:59:024
2935199141,9cyclictest16495-21ssh21:25:104
2935199141,10cyclictest13918-21ssh22:35:474
2935199140,10cyclictest9565-21chrt21:39:344
2935199140,10cyclictest9025-21rm21:20:224
2935199140,10cyclictest6784-21grep19:30:134
2935199140,10cyclictest31149-21ssh23:40:244
2935199140,10cyclictest27737-21ssh00:34:424
2935199140,10cyclictest25519-21ssh23:37:434
2935199140,10cyclictest23217-21rm23:00:024
2935199140,10cyclictest21757-21chrt22:40:224
2935199140,10cyclictest17236-21cut21:00:134
2935199140,10cyclictest14246-21sh22:18:204
2935199140,10cyclictest12936-21sh00:07:254
2935099141,9cyclictest9922-21ssh21:20:383
2935099141,9cyclictest734-21sshd22:10:043
2935099141,9cyclictest5728-21diskstats20:35:143
2935099141,9cyclictest5295-21ssh21:36:293
2935099141,9cyclictest31560-21sh00:36:053
2935099141,9cyclictest26217-21fschecks_count00:15:143
2935099141,9cyclictest23691-21/usr/sbin/munin21:10:243
2935099141,9cyclictest20259-21sh22:40:103
2935099141,9cyclictest10821-21sh22:15:503
2935099141,9cyclictest10263-21ssh21:57:573
2935099141,10cyclictest31576-21ssh23:04:573
2935099141,10cyclictest10990-21sh22:52:453
29350991410,3cyclictest24542-21unixbench-2d22:05:233
2935099140,10cyclictest7464-21ssh22:32:423
2935099140,10cyclictest4269-21wc23:25:243
2935099140,10cyclictest3206-21ssh22:48:333
2935099140,10cyclictest31958-21/usr/sbin/munin00:00:253
2935099140,10cyclictest31172-21/usr/sbin/munin21:15:173
2935099140,10cyclictest31172-21/usr/sbin/munin21:15:173
2935099140,10cyclictest31155-21cat20:20:183
2935099140,10cyclictest31022-21sed19:10:243
2935099140,10cyclictest28830-21df21:50:163
2935099140,10cyclictest26120-21ssh23:56:143
2935099140,10cyclictest26120-21ssh23:56:143
2935099140,10cyclictest25559-21sh23:19:573
2935099140,10cyclictest25330-21sh21:30:103
2935099140,10cyclictest25161-21sed20:10:003
2935099140,10cyclictest24805-21ssh22:24:353
2935099140,10cyclictest24759-21ssh23:37:113
2935099140,10cyclictest22298-21ssh00:30:433
2935099140,10cyclictest21419-21sh22:58:583
2935099140,10cyclictest19232-21/usr/sbin/munin21:05:153
2935099140,10cyclictest18433-21sed21:25:243
2935099140,10cyclictest18348-21runrttasks19:55:133
2935099140,10cyclictest1833-21/usr/sbin/munin19:20:253
2935099140,10cyclictest17887-21ssh22:38:403
2935099140,10cyclictest16925-21chrt00:10:083
2935099140,10cyclictest13303-21rm00:25:323
2935099140,10cyclictest12663-21diskstats20:50:163
2935099140,10cyclictest12338-21ssh23:11:413
2935099140,10cyclictest12338-21ssh23:11:413
2935099140,10cyclictest11825-21wc21:40:193
2935099140,10cyclictest11711-21sh23:48:293
2935099140,10cyclictest11172-21ssh23:30:013
2934999143,8cyclictest321-21systemd-journal19:18:042
2934999141,9cyclictest829-21sh00:00:212
2934999141,9cyclictest3634-21fw_packets20:30:152
2934999141,9cyclictest30791-21systemctl22:45:222
2934999141,9cyclictest30204-21runrttasks20:20:082
2934999141,9cyclictest29611-21/usr/sbin/munin19:10:172
2934999141,9cyclictest24089-21diskmemload00:32:012
2934999141,9cyclictest21232-21diskmemload22:35:092
2934999141,9cyclictest20425-21/usr/sbin/munin23:35:242
2934999141,10cyclictest4140-21runrttasks22:12:232
2934999141,10cyclictest12261-21ls19:40:172
2934999140,12cyclictest23285-21ssh23:00:062
2934999140,10cyclictest9990-21chrt20:45:092
2934999140,10cyclictest8442-21sh23:46:052
2934999140,10cyclictest8362-21wget00:05:132
2934999140,10cyclictest774-21runrttasks20:50:522
2934999140,10cyclictest7691-21/usr/sbin/munin20:40:232
2934999140,10cyclictest5375-21sh23:26:012
2934999140,10cyclictest350-21/usr/sbin/munin20:25:262
2934999140,10cyclictest32078-21ssh23:05:052
2934999140,10cyclictest25534-21ssh23:55:492
2934999140,10cyclictest25534-21ssh23:55:482
2934999140,10cyclictest22834-21hddtemp_smartct21:10:152
2934999140,10cyclictest2281-21ssh22:30:092
2934999140,10cyclictest22229-21sh21:28:082
2934999140,10cyclictest21471-21ssh23:54:142
2934999140,10cyclictest2069-21ssh00:20:072
2934999140,10cyclictest20290-21/usr/sbin/munin22:40:132
2934999140,10cyclictest19764-21sh22:20:552
2934999140,10cyclictest19451-21ssh23:15:292
2934999140,10cyclictest14815-21sh23:31:302
2934999140,10cyclictest14161-21wc22:00:142
2934999140,10cyclictest11169-21ssh22:52:532
2934999140,10cyclictest10634-21chrt19:37:522
2934799146,6cyclictest711-21snmpd23:31:071
2934799146,6cyclictest700-21gdbus19:40:001
2934799143,8cyclictest9668-21cat23:10:181
2934799143,8cyclictest9668-21cat23:10:181
2934799143,8cyclictest652-21tr22:10:211
2934799142,9cyclictest711-21snmpd21:55:071
2934799141,9cyclictest8187-21sh22:50:431
2934799141,9cyclictest23055-21/usr/sbin/munin23:55:131
2934799141,9cyclictest23055-21/usr/sbin/munin23:55:121
2934799141,9cyclictest1949-21sh21:53:201
2934799141,9cyclictest13734-21/usr/sbin/munin19:45:191
2934799141,6cyclictest22115-21/usr/sbin/munin22:40:261
2934799141,10cyclictest4883-21runrttasks20:32:431
2934799141,10cyclictest25449-21ssh23:19:521
2934799140,7cyclictest3409-21rm22:30:211
2934799140,10cyclictest8092-21chrt22:15:021
2934799140,10cyclictest7975-21sh00:23:161
2934799140,10cyclictest7367-21ssh23:09:281
2934799140,10cyclictest6707-21sort19:30:121
2934799140,10cyclictest5483-21sh23:45:071
2934799140,10cyclictest4194-21apt-get19:25:121
2934799140,10cyclictest31958-21/usr/sbin/munin00:00:251
2934799140,10cyclictest30219-21ssh00:35:241
2934799140,10cyclictest30209-21/usr/sbin/munin20:20:201
2934799140,10cyclictest29303-21ssh21:31:531
2934799140,10cyclictest27293-21apt-get20:14:591
2934799140,10cyclictest2573-21/usr/sbin/munin23:25:201
2934799140,10cyclictest24102-21ssh21:10:281
2934799140,10cyclictest23912-21ssh22:23:561
2934799140,10cyclictest2382-21fschecks_time21:35:151
2934799140,10cyclictest23554-21ssh23:36:171
2934799140,10cyclictest22683-21sh22:05:071
2934799140,10cyclictest22507-21ssh21:46:081
2934799140,10cyclictest21865-21grep00:30:281
2934799140,10cyclictest20663-21/usr/sbin/munin20:00:191
2934799140,10cyclictest18967-21ssh23:52:241
2934799140,10cyclictest17278-21ssh22:55:571
2934799140,10cyclictest16752-21sh00:10:001
2934799140,10cyclictest16533-21/usr/sbin/munin21:25:131
2934799140,10cyclictest1621-21ssh23:42:321
2934799140,10cyclictest13929-21sh22:00:091
2934799140,10cyclictest13243-21ssh00:07:381
2934799140,10cyclictest11469-21cpuspeed00:25:131
2934299148,5cyclictest10491-21cut20:45:140
2934299146,6cyclictest21754-21sensors_temp22:40:220
2934299144,8cyclictest12756-21sendmail_mailtr23:30:190
2934299142,5cyclictest4268-21grep20:30:200
2934299142,10cyclictest3124-21sed22:30:180
2934299141,9cyclictest32460-21ssh23:05:140
2934299141,9cyclictest321-21systemd-journal19:30:030
2934299141,9cyclictest13470-21/usr/sbin/munin20:50:220
2934299141,8cyclictest32112-21runrttasks20:23:470
2934299141,11cyclictest28916-21gpg-connect-age22:45:010
2934299141,10cyclictest103-1kworker/0:1H+kblockd23:35:250
2934299140,12cyclictest14589-21sh22:55:090
2934299140,12cyclictest11800-21tr22:35:150
2934299140,10cyclictest774-21runrttasks20:01:440
2934299140,10cyclictest2901-21sh00:38:490
2934299140,10cyclictest27848-21packagekitd20:15:020
2934299140,10cyclictest18697-21df19:55:130
47292134,2sleep40-21swapper/400:20:534
2935199139,3cyclictest23182-21cpuspeed_turbos20:05:124
2935199139,3cyclictest22786-21gltestperf21:10:154
2935199131,9cyclictest9922-21sh23:47:104
2935199130,9cyclictest8980-21cut23:10:154
2935199130,9cyclictest8980-21cut23:10:144
2935199130,9cyclictest8801-21/usr/sbin/munin19:35:244
2935199130,9cyclictest774-21runrttasks22:10:354
2935199130,9cyclictest774-21runrttasks00:35:124
2935199130,9cyclictest7691-21/usr/sbin/munin20:40:174
2935199130,9cyclictest752-21postgres20:46:474
2935199130,9cyclictest4817-21runrttasks20:31:504
2935199130,9cyclictest32277-21entropy19:15:154
2935199130,9cyclictest32122-21sh23:05:074
2935199130,9cyclictest321-21systemd-journal19:10:044
2935199130,9cyclictest31958-21/usr/sbin/munin00:00:264
2935199130,9cyclictest31172-21/usr/sbin/munin21:15:154
2935199130,9cyclictest31172-21/usr/sbin/munin21:15:154
2935199130,9cyclictest30243-21wget20:20:124
2935199130,9cyclictest28159-21grep20:15:134
2935199130,9cyclictest26126-21ssh23:20:084
2935199130,9cyclictest25890-21gltestperf20:10:164
2935199130,9cyclictest24954-21rm22:05:364
2935199130,9cyclictest21482-21chrt23:16:584
2935199130,9cyclictest2101-21expr19:20:154
2935199130,9cyclictest20124-21runrttasks19:57:114
2935199130,9cyclictest19572-21/usr/sbin/munin21:45:134
2935199130,9cyclictest19320-21wget21:05:154
2935199130,9cyclictest17510-21sh23:51:204
2935199130,9cyclictest17128-21munin-node22:20:114
2935199130,9cyclictest16751-21rm00:10:004
2935199130,9cyclictest16298-21ssh22:00:414
2935199130,9cyclictest14460-21sshd22:55:044
2935199130,9cyclictest14248-21ssh23:31:054
2935199130,9cyclictest12669-21sensors_volt00:25:224
2935199130,9cyclictest12658-21grep19:40:204
2935199130,9cyclictest12300-21/usr/sbin/munin20:50:274
2935199130,9cyclictest11175-21df_inode21:40:154
2935199130,10cyclictest774-21runrttasks19:26:124
2935199130,10cyclictest5629-21ssh22:50:034
2935199130,10cyclictest5549-21sh23:26:084
2935199130,10cyclictest31669-21ssh22:45:404
2935199130,10cyclictest25590-21ssh00:15:044
2935099130,9cyclictest8089-21/usr/sbin/munin19:30:263
2935099130,9cyclictest774-21runrttasks19:50:173
2935099130,9cyclictest7691-21/usr/sbin/munin20:40:103
2935099130,9cyclictest651-21mailstats19:15:203
2935099130,9cyclictest4983-21sshd20:34:043
2935099130,9cyclictest4190-21/usr/sbin/munin19:25:133
2935099130,9cyclictest25270-21/usr/sbin/munin20:10:203
2935099130,9cyclictest2341-21/usr/sbin/munin00:20:143
2935099130,9cyclictest2312-21runrttasks20:28:523
2935099130,9cyclictest21073-21sh21:45:223
2935099130,9cyclictest21016-21sh20:00:123
2935099130,9cyclictest14720-21cpu20:55:123
2935099130,9cyclictest14239-21sh23:50:093
2935099130,9cyclictest13734-21/usr/sbin/munin19:45:133
2935099130,9cyclictest10989-21sh00:05:593
2935099130,9cyclictest10512-21runrttasks19:36:133
2935099130,10cyclictest32616-21cstates23:05:143
2935099130,10cyclictest30810-21awk23:40:223
2935099130,10cyclictest28199-21ssh22:25:393
2935099130,10cyclictest18140-21which21:00:203
2935099130,10cyclictest12221-21cat19:40:173
2934999135,6cyclictest4293-21cut19:25:132
2934999132,8cyclictest18781-21sed00:10:252
2934999130,9cyclictest8066-21sh22:15:012
2934999130,9cyclictest7746-21/usr/sbin/munin21:20:222
2934999130,9cyclictest774-21runrttasks19:50:102
2934999130,9cyclictest5371-21apt-get20:35:122
2934999130,9cyclictest5329-21ssh21:55:152
2934999130,9cyclictest28718-21ssh00:35:132
2934999130,9cyclictest28454-21/usr/sbin/munin21:50:202
2934999130,9cyclictest27873-21/usr/sbin/munin20:15:202
2934999130,9cyclictest25750-21/usr/sbin/munin00:15:192
2934999130,9cyclictest25746-21ssh22:25:032
2934999130,9cyclictest25270-21/usr/sbin/munin20:10:152
2934999130,9cyclictest22967-21/usr/sbin/munin20:05:112
2934999130,9cyclictest21709-21taskset21:45:332
2934999130,9cyclictest19232-21/usr/sbin/munin21:05:152
2934999130,9cyclictest18420-21aten2_r5power_p19:55:132
2934999130,9cyclictest1833-21/usr/sbin/munin19:20:242
2934999130,9cyclictest16928-21/usr/sbin/munin21:00:122
2934999130,9cyclictest15332-21if_err_enp6s020:55:152
2934999130,9cyclictest14405-21sh22:55:022
2934999130,9cyclictest13734-21/usr/sbin/munin19:45:192
2934999130,9cyclictest10764-21/usr/sbin/munin21:40:142
2934999130,10cyclictest21095-21fschecks_count20:00:132
2934999130,10cyclictest14471-21sh00:26:222
2934799131,9cyclictest774-21runrttasks22:25:101
2934799131,9cyclictest28856-21needreboot20:15:191
2934799130,9cyclictest774-21runrttasks20:55:321
2934799130,9cyclictest5406-21aten2_r5power_e20:35:131
2934799130,9cyclictest31913-21/usr/sbin/munin19:15:131
2934799130,9cyclictest30962-21runrttasks21:15:021
2934799130,9cyclictest30962-21runrttasks21:15:021
2934799130,9cyclictest29015-21apt-key22:45:011
2934799130,9cyclictest23836-21load20:05:161
2934799130,9cyclictest23441-21/usr/sbin/munin23:00:171
2934799130,9cyclictest1833-21/usr/sbin/munin19:20:181
2934799130,9cyclictest16979-21aten2_r5power_e21:00:121
2934799130,9cyclictest12563-21cpuspeed_turbos20:50:141
2934799130,9cyclictest10543-21ssh21:40:031
2934799130,10cyclictest19741-21fschecks_time21:05:171
2934799130,10cyclictest16294-21cut19:50:141
2934799130,10cyclictest13451-21sort19:45:011
2934799130,10cyclictest1167-21kernelversion20:25:191
2934799130,10cyclictest11524-21sh22:35:141
2934299131,9cyclictest774-21runrttasks20:05:030
2934299131,8cyclictest9850-21ntpq19:35:200
2934299131,8cyclictest17457-21perl21:00:140
2934299131,8cyclictest16394-21df_inode19:50:150
2934299130,9cyclictest774-21runrttasks19:10:040
2934299130,9cyclictest26512-21/usr/sbin/munin20:10:210
2934299130,9cyclictest14751-21netstat19:45:200
2934299130,9cyclictest1158-21runrttasks19:15:310
2934299130,7cyclictest774-21runrttasks19:25:400
2934299130,10cyclictest8414-21/usr/sbin/munin20:40:160
2934299130,10cyclictest3629-21taskset19:21:370
2934299130,10cyclictest29296-21latency_hist19:10:000
2934299130,10cyclictest1069-21/usr/sbin/munin20:25:170
2935199124,6cyclictest20681-21hostname20:00:114
2935199120,9cyclictest6404-21awk20:35:194
2935199120,9cyclictest16539-21fschecks_time19:50:164
2935199120,9cyclictest15813-21sendmail_mailtr20:55:194
2935199120,8cyclictest1413250tune2fs19:45:164
2935099120,9cyclictest11695-21taskset20:46:043
2934999124,6cyclictest6789-21cpuspeed_turbos19:30:132
2934799124,6cyclictest18346-21dpkg19:55:121
2934299120,9cyclictest5528-21runrttasks20:35:130
161332120,1sleep50-21swapper/522:00:345
69522110,1sleep50-21swapper/500:04:285
68272110,1sleep50-21swapper/521:19:495
68272110,1sleep50-21swapper/521:19:495
68012110,1sleep50-21swapper/523:45:185
2935099113,6cyclictest29534-21cat19:10:003
2934799113,6cyclictest29425-21cut19:09:591
144962110,1sleep50-21swapper/500:26:265
316422100,1sleep50-21swapper/523:40:465
2935199101,7cyclictest29420-21latency_hist19:10:004
2934999101,7cyclictest29408-21latency_hist19:09:592
292112100,1sleep50-21swapper/523:21:135
250542100,1sleep50-21swapper/522:42:305
198512100,1sleep50-21swapper/523:15:485
12283290,1sleep50-21swapper/520:50:015
15401280,0sleep50-21swapper/522:36:535
8285262,2sleep50-21swapper/522:50:505
5121260,1sleep50-21swapper/522:49:555
2928250,3sleep50-21swapper/500:38:525
26454252,1sleep50-21swapper/521:49:025
18708252,1sleep50-21swapper/523:52:135
9681240,1sleep50-21swapper/520:45:015
8544240,1sleep50-21swapper/519:35:025
8479240,1sleep50-21swapper/519:34:555
8047240,1sleep50-21swapper/522:15:015
7108240,1sleep50-21swapper/521:20:015
6181240,1sleep50-21swapper/519:30:015
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional