You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-08 - 06:44
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Tue Sep 08, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
926021000,1sleep49263-21grep00:15:244
229232940,1sleep10-21swapper/122:34:501
164662920,0sleep00-21swapper/023:25:180
890699220,19cyclictest27027-21sh22:00:170
17092210,0sleep00-21swapper/021:28:370
17092210,0sleep00-21swapper/021:28:370
890699203,14cyclictest0-21swapper/023:17:250
890699201,7cyclictest32750-21latency_hist23:35:000
890699200,8cyclictest9565-21diskstats22:45:150
890699200,7cyclictest8433-21ssh21:32:050
890699200,7cyclictest4249-21chrt23:55:100
890699200,7cyclictest15809-21munin-run00:20:010
890699200,18cyclictest14803-21sh21:53:550
890699200,18cyclictest11604-21sh22:10:150
890699195,7cyclictest1693-21sh22:40:210
890699191,7cyclictest24670-21sh23:48:070
890699190,8cyclictest12892-21taskset23:41:000
890699190,7cyclictest9517-21latency_hist23:40:000
890699190,7cyclictest4969-21ssh22:05:420
890699190,7cyclictest3626-21sh23:54:560
890699190,7cyclictest3626-21sh23:54:560
890699190,7cyclictest31741-21df21:45:130
890699190,7cyclictest30302-21sed22:20:170
890699190,7cyclictest22995-21sh00:23:490
890699190,7cyclictest17499-21sh21:36:530
890699190,7cyclictest13207-21ssh23:05:150
890699190,7cyclictest10555-21sh00:35:030
890699190,6cyclictest60150irq/18-enp6s022:30:120
890699190,6cyclictest32729-21sort00:10:270
890699190,6cyclictest20749-21ssh22:50:560
890699190,5cyclictest27252-21sensors_volt19:45:210
890699190,17cyclictest9309-21sh00:34:220
890699190,17cyclictest8489-21ssh22:25:540
890699190,17cyclictest30978-21ssh00:28:000
890699190,17cyclictest23478-21/usr/sbin/munin21:40:190
890699190,17cyclictest18567-21sh21:20:040
890699190,17cyclictest18567-21sh21:20:030
890699190,17cyclictest16486-21sh00:01:190
8914991811,5cyclictest20778-21apt23:10:002
890699185,11cyclictest15261-21sh21:17:560
890699184,6cyclictest22176-21cat19:35:170
890699184,6cyclictest16747-21cpuspeed_turbos19:25:130
890699184,6cyclictest12301-21fschecks_time19:15:140
890699183,6cyclictest21501-21cut23:10:160
890699181,9cyclictest23755-21expr00:05:220
890699180,7cyclictest8873-21ssh23:20:350
890699180,7cyclictest774-21runrttasks20:31:060
890699180,7cyclictest774-21runrttasks20:26:430
890699180,7cyclictest6512-21sh23:01:110
890699180,7cyclictest30421-21ssh22:56:270
890699180,7cyclictest25740-21sh22:35:300
890699180,6cyclictest17523-21grep21:55:150
890699180,16cyclictest9165-21awk21:15:000
890699180,14cyclictest26510-21sh22:18:220
891999174,9cyclictest1-21systemd22:50:253
891999170,9cyclictest27863-21sh21:42:563
8914991710,5cyclictest25235-21apt22:00:002
8914991710,5cyclictest22937-21grep20:45:232
891199175,8cyclictest321-21systemd-journal00:15:011
890699174,6cyclictest24138-21cut20:50:130
890699173,6cyclictest17403-21which20:35:160
890699171,7cyclictest21607-21grep20:45:130
890699170,8cyclictest3182-21df20:05:140
890699170,8cyclictest19077-21dpkg19:30:130
890699170,6cyclictest774-21runrttasks21:01:090
890699170,16cyclictest20280-21systemctl20:40:200
890699170,15cyclictest774-21runrttasks19:41:130
890699170,15cyclictest103-1kworker/0:1H+kblockd20:55:130
892399164,9cyclictest1-21systemd21:32:374
891999164,9cyclictest711-21snmpd20:30:363
891199168,6cyclictest21923-21grep23:10:181
891199163,9cyclictest9309-21seq20:18:191
890699164,6cyclictest8107-21idleruntime20:15:170
890699161,7cyclictest5795-21hddtemp_smartct20:10:150
890699161,7cyclictest469-21apt20:00:100
890699161,7cyclictest31326-21/usr/sbin/munin21:05:190
890699161,7cyclictest28307-21/usr/sbin/munin19:50:120
890699160,8cyclictest9805-21tail19:10:150
890699160,8cyclictest9805-21tail19:10:150
890699160,8cyclictest9760-21chrt20:20:090
890699160,7cyclictest774-21runrttasks19:20:060
890699160,7cyclictest30674-21basename19:55:130
892399151,10cyclictest17494-21grep00:20:184
891999154,8cyclictest22660-21switchtime20:45:223
891999151,10cyclictest774-21runrttasks21:18:473
891999151,10cyclictest25236-21latency_hist22:00:003
891999151,10cyclictest1422-21rm23:16:393
891499157,6cyclictest12787-21tr22:10:212
891499155,7cyclictest6100-21kworker/u24:5+nfsiod21:13:522
891499151,10cyclictest8003-21runrttasks22:25:342
891199156,7cyclictest1104-21grep20:00:141
891199155,8cyclictest11179-21/usr/sbin/munin21:15:221
891199153,9cyclictest711-21snmpd21:00:371
891199151,10cyclictest30722-21ssh22:56:401
891199151,10cyclictest22114-21/usr/sbin/munin00:05:141
891199151,10cyclictest19753-21sed22:50:281
891199151,10cyclictest11727-21ssh23:59:231
891199150,11cyclictest20309-21ssh21:56:291
890699150,7cyclictest8973-21sed19:10:000
892399144,8cyclictest15640-21/usr/sbin/munin20:30:194
892399143,8cyclictest23450-21processes00:05:194
892399141,9cyclictest774-21runrttasks19:59:504
892399141,9cyclictest4643-21runrttasks20:07:384
892399141,9cyclictest28692-21runrttasks22:19:564
892399141,9cyclictest25574-21wget00:25:124
892399141,9cyclictest15461-21runrttasks23:42:514
892399141,10cyclictest12993-21memory20:25:184
892399140,10cyclictest7949-21chrt23:38:544
892399140,10cyclictest30214-21ssh23:15:124
892399140,10cyclictest26347-21sh21:41:504
892399140,10cyclictest2365-21xargs21:10:234
892399140,10cyclictest2295-21sh00:11:404
892399140,10cyclictest20276-21mailstats19:30:214
892399140,10cyclictest20161-21sh23:09:354
892399140,10cyclictest18946-21cat20:40:004
892399140,10cyclictest17242-21sh00:38:414
892399140,10cyclictest12811-21ssh21:16:114
891999143,8cyclictest29812-21unixbench-2d21:00:263
891999141,9cyclictest774-21runrttasks00:21:173
891999141,9cyclictest7111-21diskmemload23:56:033
891999141,9cyclictest6970-21sh22:25:193
891999141,9cyclictest2801-21/usr/sbin/munin22:05:133
891999141,9cyclictest25469-21taskset19:41:583
891999141,9cyclictest17775-21/usr/sbin/munin19:25:233
891999141,9cyclictest1430-21sh21:45:503
891999141,10cyclictest774-21runrttasks19:34:503
891999141,10cyclictest3857-21ssh23:35:563
891999141,10cyclictest31349-21ssh00:28:153
891999141,10cyclictest2277-21runrttasks20:01:463
891999140,10cyclictest9418-21cat21:50:223
891999140,10cyclictest774-21runrttasks20:43:403
891999140,10cyclictest774-21runrttasks00:10:093
891999140,10cyclictest7449-21/usr/sbin/munin00:15:213
891999140,10cyclictest7429-21/usr/sbin/munin20:15:133
891999140,10cyclictest6641-21sh23:20:113
891999140,10cyclictest586-21sh22:40:153
891999140,10cyclictest5751-21ssh00:31:483
891999140,10cyclictest4628-21grep21:30:163
891999140,10cyclictest3457-21sh23:00:093
891999140,10cyclictest31483-21sh21:26:443
891999140,10cyclictest31483-21sh21:26:433
891999140,10cyclictest30598-21/usr/sbin/munin21:05:203
891999140,10cyclictest30093-21ssh22:56:143
891999140,10cyclictest29940-21rm22:02:003
891999140,10cyclictest29424-21sh22:38:073
891999140,10cyclictest29231-21ssh23:32:283
891999140,10cyclictest29150-21sh22:20:013
891999140,10cyclictest28306-21/usr/sbin/munin19:50:203
891999140,10cyclictest23663-21/usr/sbin/munin20:50:163
891999140,10cyclictest22513-21sh22:15:313
891999140,10cyclictest22114-21/usr/sbin/munin00:05:123
891999140,10cyclictest21374-21/usr/sbin/munin19:35:173
891999140,10cyclictest21102-21sh23:10:013
891999140,10cyclictest18818-21ssh23:45:053
891999140,10cyclictest18807-21apt-get21:20:133
891999140,10cyclictest18807-21apt-get21:20:133
891999140,10cyclictest17769-21sh23:07:513
891999140,10cyclictest17731-21grep20:35:193
891999140,10cyclictest1700-21sed21:10:173
891999140,10cyclictest16315-21sh22:30:233
891999140,10cyclictest15936-21sh21:35:463
891999140,10cyclictest15606-21/usr/sbin/munin23:25:243
891999140,10cyclictest14888-21ssh23:42:263
891999140,10cyclictest13793-21taskset19:19:353
891999140,10cyclictest13294-21/usr/sbin/munin00:00:173
891999140,10cyclictest12990-21sh22:10:233
891999140,10cyclictest12785-21hddtemp_smartct20:25:153
891999140,10cyclictest1179-21sh23:53:103
891999140,10cyclictest1179-21sh23:53:093
891999140,10cyclictest10745-21/usr/sbin/munin00:35:173
891499143,8cyclictest751-21postgres20:09:582
891499142,9cyclictest27612-21vmstat20:55:232
891499141,9cyclictest774-21runrttasks19:23:552
891499141,9cyclictest31083-21/usr/sbin/munin00:10:222
891499141,9cyclictest29348-21diskmemload22:20:102
891499141,9cyclictest26278-21diskmemload00:07:002
891499141,9cyclictest24207-21sh23:30:012
891499141,9cyclictest15280-21rm21:17:582
891499141,9cyclictest12687-40mandb00:00:022
891499141,10cyclictest23941-21runrttasks22:16:322
891499141,10cyclictest2207-21runrttasks20:00:492
891499141,10cyclictest18834-21sh00:20:482
891499140,12cyclictest20136-21ssh22:32:502
891499140,11cyclictest28309-21ssh00:26:032
891499140,10cyclictest9172-21/usr/sbin/munin19:10:252
891499140,10cyclictest9172-21/usr/sbin/munin19:10:252
891499140,10cyclictest8455-21unixbench-2d23:20:232
891499140,10cyclictest5082-21sort21:30:202
891499140,10cyclictest4685-21diskstats23:55:132
891499140,10cyclictest3352-21rm21:47:122
891499140,10cyclictest32528-21ssh23:15:422
891499140,10cyclictest31632-21ssh22:57:202
891499140,10cyclictest27920-21chrt19:48:582
891499140,10cyclictest27585-21runrttasks23:50:022
891499140,10cyclictest27585-21runrttasks23:50:012
891499140,10cyclictest27202-21ssh22:36:322
891499140,10cyclictest26129-21sh21:41:402
891499140,10cyclictest25675-21runrttasks19:44:472
891499140,10cyclictest25357-21sh22:54:142
891499140,10cyclictest21730-21df_inode19:35:142
891499140,10cyclictest2163-21cat23:35:152
891499140,10cyclictest21462-21aten2_r5power_c23:10:152
891499140,10cyclictest19075-21ssh23:26:312
891499140,10cyclictest18987-21/usr/sbin/munin23:45:182
891499140,10cyclictest18596-21runrttasks20:38:132
891499140,10cyclictest17325-21ssh22:49:512
891499140,10cyclictest14651-21sort20:30:122
891499140,10cyclictest13729-21rm00:18:322
891499140,10cyclictest13540-21sh23:41:292
891499140,10cyclictest13506-21ssh21:35:122
891499140,10cyclictest12120-21/usr/sbin/munin20:25:182
891499140,10cyclictest10584-21sh00:35:042
891199146,6cyclictest7597-21grep22:25:241
891199145,7cyclictest26669-21ssh22:36:101
891199142,9cyclictest31842-21cut19:55:211
891199142,8cyclictest2194-21cpuspeed_turbos00:30:161
891199141,9cyclictest31679-21ssh22:20:411
891199141,9cyclictest14155-21/usr/sbin/munin19:20:121
891199141,9cyclictest12447-21expr20:25:131
891199141,9cyclictest10821-21runrttasks20:20:191
891199141,10cyclictest14448-21rm22:11:071
8911991410,3cyclictest21829-21mailstats22:15:191
891199140,9cyclictest774-21runrttasks20:07:001
891199140,10cyclictest9357-21sh23:20:561
891199140,10cyclictest821-21ssh00:10:361
891199140,10cyclictest774-21runrttasks22:40:331
891199140,10cyclictest774-21runrttasks20:38:551
891199140,10cyclictest7669-21ssh21:50:031
891199140,10cyclictest721-21/usr/sbin/munin21:10:121
891199140,10cyclictest711-21snmpd20:57:081
891199140,10cyclictest711-21snmpd19:15:311
891199140,10cyclictest5127-21/usr/sbin/munin20:10:141
891199140,10cyclictest5053-21ssh21:30:201
891199140,10cyclictest3513-21/usr/sbin/munin23:00:171
891199140,10cyclictest3351-21ssh23:35:341
891199140,10cyclictest32704-21rm21:45:201
891199140,10cyclictest31389-21runrttasks23:15:191
891199140,10cyclictest29570-21rm00:26:581
891199140,10cyclictest28960-21rm23:32:171
891199140,10cyclictest28711-21ssh23:50:211
891199140,10cyclictest28711-21ssh23:50:201
891199140,10cyclictest28657-21df19:50:141
891199140,10cyclictest28296-21ssh22:00:481
891199140,10cyclictest27549-21ssh21:25:031
891199140,10cyclictest27549-21ssh21:25:031
891199140,10cyclictest25396-21taskset19:41:001
891199140,10cyclictest24892-21sh21:40:471
891199140,10cyclictest2484-21diskmemload22:05:061
891199140,10cyclictest20123-21ssh23:45:171
891199140,10cyclictest19061-21/usr/sbin/munin20:40:251
891199140,10cyclictest18552-21ssh21:20:041
891199140,10cyclictest18552-21ssh21:20:031
891199140,10cyclictest18146-21runrttasks19:25:461
891199140,10cyclictest16994-21runrttasks23:25:211
891199140,10cyclictest16362-21/usr/sbin/munin00:20:231
891199140,10cyclictest16225-21ssh23:06:441
891199140,10cyclictest14359-21sh23:42:041
891199140,10cyclictest13335-21sh21:35:051
891199140,10cyclictest13295-21ssh22:46:581
891199140,10cyclictest13294-21/usr/sbin/munin00:00:151
891199140,10cyclictest11152-21runrttasks19:14:521
891199140,10cyclictest11152-21runrttasks19:14:521
891199140,10cyclictest10635-21ssh00:35:061
892399136,6cyclictest22257-21grep19:35:184
892399136,5cyclictest6281-21sh22:25:154
892399131,9cyclictest9931-21/usr/sbin/munin20:20:124
892399131,9cyclictest5200-21sh00:31:244
892399131,9cyclictest25967-21/usr/sbin/munin20:55:114
892399131,9cyclictest18653-21timerwakeupswit21:55:234
892399131,9cyclictest10979-21sed22:45:244
892399131,8cyclictest2980-21sh21:46:564
892399130,9cyclictest9055-21rm23:20:444
892399130,9cyclictest774-21runrttasks22:21:204
892399130,9cyclictest774-21runrttasks19:10:334
892399130,9cyclictest774-21runrttasks19:10:324
892399130,9cyclictest7688-21rm21:50:044
892399130,9cyclictest5596-21fschecks_time20:10:144
892399130,9cyclictest4137-21rm23:55:054
892399130,9cyclictest32458-21sh22:40:054
892399130,9cyclictest31217-21ssh23:51:274
892399130,9cyclictest31217-21ssh23:51:264
892399130,9cyclictest30633-21grep21:05:154
892399130,9cyclictest29675-21sh21:25:274
892399130,9cyclictest29675-21sh21:25:264
892399130,9cyclictest27446-21ssh22:55:154
892399130,9cyclictest26002-21/usr/sbin/munin19:45:214
892399130,9cyclictest2568-21sh22:05:094
892399130,9cyclictest24757-21runrttasks20:50:184
892399130,9cyclictest24435-21/usr/sbin/munin23:30:174
892399130,9cyclictest23696-21/usr/sbin/munin19:40:204
892399130,9cyclictest21360-21/usr/sbin/munin20:45:144
892399130,9cyclictest21136-21ssh23:10:024
892399130,9cyclictest18987-21/usr/sbin/munin23:45:154
892399130,9cyclictest18187-21/usr/sbin/munin22:50:254
892399130,9cyclictest17170-21if_enp6s019:25:164
892399130,9cyclictest16535-21ssh21:36:134
892399130,9cyclictest15606-21/usr/sbin/munin23:25:134
892399130,9cyclictest14155-21/usr/sbin/munin19:20:134
892399130,9cyclictest13295-21ssh00:00:104
892399130,9cyclictest11774-21/usr/sbin/munin19:15:184
892399130,10cyclictest5961-21taskset23:00:474
892399130,10cyclictest30188-21chrt19:53:314
892399130,10cyclictest28854-21fschecks_time21:00:164
892399130,10cyclictest26636-21ssh22:36:074
892399130,10cyclictest25585-21ssh22:00:034
892399130,10cyclictest19645-21gltestperf20:40:154
892399130,10cyclictest18582-21sh21:20:044
892399130,10cyclictest18582-21sh21:20:044
892399130,10cyclictest15570-21hddtemp_smartct22:30:154
892399130,10cyclictest12689-21tail22:10:194
891999130,9cyclictest9763-21/usr/sbin/munin20:20:123
891999130,9cyclictest9162-21chrt19:10:033
891999130,9cyclictest9162-21chrt19:10:033
891999130,9cyclictest5127-21/usr/sbin/munin20:10:193
891999130,9cyclictest25967-21/usr/sbin/munin20:55:163
891999130,9cyclictest14846-21idleruntime19:20:153
891999130,9cyclictest10128-21load22:45:183
891999130,10cyclictest3186-21diskstats20:05:153
891999130,10cyclictest30607-21/usr/sbin/munin19:55:133
891999130,10cyclictest26367-21entropy19:45:143
891499132,7cyclictest20712-21kworker/u24:5+nfsiod22:40:032
891499131,9cyclictest27947-21cpuspeed_turbos21:25:122
891499131,9cyclictest27947-21cpuspeed_turbos21:25:122
891499131,9cyclictest1669-21sh00:30:022
891499130,9cyclictest9920-21ssh21:50:292
891499130,9cyclictest774-21runrttasks20:50:082
891499130,9cyclictest7120-21cron20:15:002
891499130,9cyclictest5195-21aten2_r5power_p20:10:132
891499130,9cyclictest5111-21ssh22:05:492
891499130,9cyclictest32603-21diskmemload21:20:192
891499130,9cyclictest32603-21diskmemload21:20:192
891499130,9cyclictest29350-21ntp_kernel_err19:50:192
891499130,9cyclictest29069-21sed21:00:202
891499130,9cyclictest25675-21sh22:00:062
891499130,9cyclictest19072-21/usr/sbin/munin19:30:182
891499130,9cyclictest11407-21runrttasks20:20:242
891499130,10cyclictest774-21runrttasks21:09:282
891499130,10cyclictest774-21runrttasks19:56:252
891499130,10cyclictest3408-21ssh23:00:082
891499130,10cyclictest321-21systemd-journal19:15:182
891199130,9cyclictest774-21runrttasks20:45:011
891199130,9cyclictest31021-21fschecks_count21:05:171
891199130,9cyclictest27051-21runrttasks19:45:191
891199130,9cyclictest24242-21gltestperf20:50:131
891199130,9cyclictest21489-21aten2_r5power_v19:35:131
891199130,9cyclictest19072-21/usr/sbin/munin19:30:141
892399120,9cyclictest8041-21grep20:15:164
892399120,9cyclictest468-21/usr/sbin/munin20:00:104
891499125,5cyclictest16809-21/usr/sbin/munin19:25:132
891499120,9cyclictest19424-21/usr/sbin/munin20:40:142
891199120,9cyclictest8858-21latency_hist19:10:011
891199120,9cyclictest15305-21missed_timers20:30:171
891999100,8cyclictest9109-21latency_hist19:10:003
891499101,7cyclictest8858-21latency_hist19:10:002
298202100,1sleep50-21swapper/500:27:115
283062100,1sleep50-21swapper/523:31:485
120352100,1sleep50-21swapper/523:22:535
9343290,1sleep50-21swapper/520:18:495
89239990,8cyclictest8929-21cat19:10:004
6507290,0sleep50-21swapper/500:14:455
22064290,0sleep50-21swapper/521:21:245
22064290,0sleep50-21swapper/521:21:235
9953280,0sleep50-21swapper/500:15:505
8527270,0sleep50-21swapper/519:05:425
21353270,0sleep50-21swapper/520:45:065
20319260,0sleep50-21swapper/521:56:295
1780260,4sleep50-21swapper/521:46:055
1618260,1sleep50-21swapper/522:04:575
14107260,1sleep50-21swapper/522:29:555
4816250,1sleep50-21swapper/520:10:005
3514250,1sleep50-21swapper/521:29:565
3514250,1sleep50-21swapper/521:29:555
30327250,1sleep50-21swapper/500:09:565
2788250,1sleep50-21swapper/522:59:565
25650250,1sleep50-21swapper/520:54:555
8845240,1sleep50-21swapper/519:10:005
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional