You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-18 - 14:29
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Thu Dec 18, 2025 12:44:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16203391710,1EcMasterDemoSyn16212-21runintdemo5min07:39:163
339021550,1sleep10-21swapper/110:05:411
8950391150,0EcMasterDemoSyn0-21swapper/107:24:031
139582860,0sleep50-21swapper/509:20:005
2086239830,0EcMasterDemoSyn2087229tAtEmLog_008:55:195
514139820,0EcMasterDemoSyn515129tAtEmLog_008:24:545
514139820,0EcMasterDemoSyn515129tAtEmLog_008:24:535
421239820,0EcMasterDemoSyn422229tAtEmLog_007:13:555
2663239820,0EcMasterDemoSyn2664229tAtEmLog_009:05:285
2193939820,0EcMasterDemoSyn2194929tAtEmLog_009:40:575
1796439820,0EcMasterDemoSyn1797429tAtEmLog_009:56:105
1366739820,0EcMasterDemoSyn1367729tAtEmLog_007:34:125
1130739820,0EcMasterDemoSyn1131729tAtEmLog_007:29:075
859139810,0EcMasterDemoSyn860129tAtEmLog_009:51:065
33539810,0EcMasterDemoSyn34529tAtEmLog_008:14:455
3160139810,0EcMasterDemoSyn3161129tAtEmLog_009:46:025
2607539810,0EcMasterDemoSyn2608529tAtEmLog_009:25:455
467839740,1EcMasterDemoSyn4687-21runintdemo5min10:41:483
1796439550,0EcMasterDemoSyn17973-21runintdemo5min09:56:101
723539280,0EcMasterDemoSyn7241-21ps12:13:051
250142220,1sleep40-21swapper/410:17:524
159022220,1sleep115823-21gzip07:37:091
1084739210,0EcMasterDemoSyn0-21swapper/512:33:225
53512180,0sleep40-21swapper/412:11:444
203499180,10cyclictest808-21postgres07:42:273
2029991810,6cyclictest9063-21cron07:25:002
202099180,14cyclictest7381-21sh12:30:520
202099180,10cyclictest10797-21sh11:03:050
1990499180,11tDemoTimingTask21980-21chrt12:39:565
2279499170,10tDemoTimingTask26711-21chrt11:30:005
202999174,9cyclictest5854-21ls11:00:182
202099174,11cyclictest15485-21cut09:55:140
202099173,10cyclictest26996-21sh11:30:120
202099170,9cyclictest32029-21ssh12:09:000
202099170,9cyclictest23358-21date09:25:000
1783129170,10tAtEmLog_019324-21chrt08:54:565
1016699170,7tDemoTimingTask11932-21chrt08:36:235
2362299160,9tDemoTimingTask24021-21chrt09:00:275
203699165,8cyclictest7046-21xargs10:25:244
203699164,9cyclictest357-21systemd-udevd09:16:174
203499160,10cyclictest27762-21aten2_r5power_v09:10:143
202599168,2cyclictest171rcu_preempt11:55:111
202599166,2cyclictest171rcu_preempt11:52:541
202599161,8cyclictest32-21ksoftirqd/112:09:201
202599161,8cyclictest32-21ksoftirqd/111:38:591
2025991612,3cyclictest731-21gdbus09:10:001
202599160,9cyclictest32-21ksoftirqd/112:22:161
202599160,9cyclictest32-21ksoftirqd/110:56:111
202599160,10cyclictest32-21ksoftirqd/112:34:051
202099160,7cyclictest28249-21perl09:10:160
1254699160,9tDemoTimingTask14757-21taskset08:45:015
3230539150,0EcMasterDemoSyn0-21swapper/210:57:012
2787099150,9tDemoTimingTask27874-21taskset10:36:445
203699154,8cyclictest27698-21unixbench_singl08:00:244
203699153,9cyclictest21020-21switchtime08:55:234
2036991511,3cyclictest11004-21gltestperf10:10:164
203699150,9cyclictest30789-21ssh10:03:344
203699150,11cyclictest24432-21ssh12:04:584
203499154,8cyclictest12231-21sed12:15:263
203499153,9cyclictest13693-21proc_pri08:40:213
203499151,10cyclictest831-21runrttasks10:39:333
203499151,10cyclictest5859-21sh11:35:393
203499151,10cyclictest32637-21runrttasks11:50:283
203499151,10cyclictest31578-21ssh09:46:013
203499151,10cyclictest31372-21sh11:32:103
203499151,10cyclictest12752-21sh11:58:043
203499151,10cyclictest10992-21sh09:52:433
203499150,11cyclictest6169-21ssh09:32:563
203499150,11cyclictest4367-21sh12:11:023
203499150,11cyclictest32262-21/usr/sbin/munin11:15:153
203499150,11cyclictest24931-21ssh09:25:203
203499150,11cyclictest20991-21sh11:08:503
203499150,11cyclictest10209-21/usr/sbin/munin08:35:143
203499150,10cyclictest18649-21ssh10:14:493
202999158,5cyclictest5712-21grep10:25:142
202999154,8cyclictest14166-21grep07:35:132
202999154,7cyclictest15391-21tune2fs10:30:162
2029991511,3cyclictest30920-21aten2_r5power_v08:10:132
2029991511,3cyclictest28488-21ssh09:45:002
202999151,10cyclictest2351-21unixbench_multi09:30:252
202999150,9cyclictest26538-21grep09:05:242
202999150,8cyclictest18012-21wc09:56:112
202999150,11cyclictest2338-21gltestperf12:10:162
202599156,5cyclictest24490-21cut09:05:001
202599155,5cyclictest19784-21if_enp5s010:50:161
202599153,7cyclictest32-21ksoftirqd/112:04:491
202599153,4cyclictest17087-21fschecks_count07:40:141
202599151,8cyclictest32-21ksoftirqd/110:00:401
202599151,10cyclictest30302-21sh10:38:251
202599151,10cyclictest30073-21/usr/sbin/munin09:45:201
202599151,10cyclictest25835-21sh11:47:011
202599151,10cyclictest12600-21ssh10:46:001
2025991510,2cyclictest171rcu_preempt10:40:481
202599150,9cyclictest32-21ksoftirqd/112:35:351
202599150,9cyclictest32-21ksoftirqd/112:26:431
202599150,9cyclictest32-21ksoftirqd/111:18:381
202599150,9cyclictest32-21ksoftirqd/111:00:121
202599150,9cyclictest32-21ksoftirqd/110:20:221
202599150,9cyclictest32-21ksoftirqd/109:40:201
202599150,9cyclictest32-21ksoftirqd/108:14:331
202599150,7cyclictest13029-21grep08:40:151
202599150,11cyclictest22669-21ssh10:34:281
202099156,7cyclictest8918-21ssh09:51:180
202099156,7cyclictest6315-21sh11:35:590
202099156,7cyclictest28259-21ssh09:27:120
202099156,7cyclictest23379-21ssh11:27:520
202099156,7cyclictest22632-21ssh12:03:400
202099156,7cyclictest14036-21ssh11:05:090
202099156,7cyclictest12397-21sh11:40:030
202099154,8cyclictest14174-21unixbench_singl08:40:260
2020991511,3cyclictest18838-21sendmail12:20:000
202099151,10cyclictest831-21runrttasks08:12:480
202099150,9cyclictest3470-21runrttasks10:05:440
202099150,9cyclictest16496-21sh12:36:010
202099150,8cyclictest27020-21diskmemload12:20:080
202099150,7cyclictest175-1kworker/0:1H+kblockd10:12:510
202099150,6cyclictest175-1kworker/0:1H+kblockd08:23:260
202099150,6cyclictest175-1kworker/0:1H+kblockd08:23:260
202099150,11cyclictest24779-21latency_hist09:05:000
202099150,10cyclictest27116-21sed09:10:000
203699146,6cyclictest644-21dbus-daemon07:35:224
203699146,6cyclictest29149-21tune2fs10:20:134
203699143,8cyclictest15815-21latency10:30:184
203699143,8cyclictest13711-21processes08:40:214
203699142,9cyclictest744-21snmpd07:51:154
203699142,9cyclictest327-21systemd-journal09:02:134
203699141,9cyclictest8667-21/usr/sbin/munin11:20:184
203699141,9cyclictest29741-21sensors_fan12:25:214
203699141,9cyclictest27501-21sh09:26:414
203699141,10cyclictest10171-21sh11:56:144
203699140,9cyclictest17202-21cut07:40:164
203699140,9cyclictest1399-21sh10:05:124
203699140,8cyclictest18523-21ssh12:37:274
203699140,12cyclictest12264-21sed08:40:004
203699140,11cyclictest28480-21ssh11:12:444
203699140,10cyclictest7852-21/usr/sbin/munin08:30:244
203699140,10cyclictest5635-21sh11:18:114
203699140,10cyclictest5556-21rm12:30:154
203699140,10cyclictest327-21systemd-journal08:11:214
203699140,10cyclictest30228-21sh12:07:444
203699140,10cyclictest29427-21sh11:49:344
203699140,10cyclictest28514-21sh10:37:114
203699140,10cyclictest26738-21chrt09:06:214
203699140,10cyclictest24088-21ssh10:52:364
203699140,10cyclictest23014-21ssh11:27:354
203699140,10cyclictest22233-21ssh09:41:084
203699140,10cyclictest1946-21ntp_kernel_err10:40:194
203699140,10cyclictest19294-21taskset08:54:314
203699140,10cyclictest19227-21sh12:20:044
203699140,10cyclictest1636-21netstat09:30:184
203699140,10cyclictest14567-21sh10:47:204
203699140,10cyclictest12768-21grep07:30:184
203699140,10cyclictest12634-21/usr/sbin/munin11:40:184
203699140,10cyclictest10279-21sh09:52:134
203499149,4cyclictest1224-21fschecks_time08:15:143
203499146,7cyclictest805-21postgres09:40:193
203499143,8cyclictest20296-21if_err_enp5s010:15:153
203499141,9cyclictest831-21runrttasks08:03:043
203499141,9cyclictest22698-21fschecks_count09:00:143
203499141,10cyclictest9574-21runrttasks08:31:183
203499141,10cyclictest18380-21ntp_kernel_err08:50:193
203499141,10cyclictest16114-21sendmail_mailst08:45:183
203499140,10cyclictest9790-21/usr/sbin/munin09:35:213
203499140,10cyclictest9370-21/usr/sbin/munin07:25:253
203499140,10cyclictest8689-21taskset07:20:353
203499140,10cyclictest831-21runrttasks12:05:093
203499140,10cyclictest831-21runrttasks11:01:413
203499140,10cyclictest831-21runrttasks07:30:023
203499140,10cyclictest5424-21/usr/sbin/munin10:25:253
203499140,10cyclictest4640-21/usr/sbin/munin07:15:143
203499140,10cyclictest4634-21sh12:30:043
203499140,10cyclictest4086-21sed08:20:153
203499140,10cyclictest4086-21sed08:20:153
203499140,10cyclictest31280-21sh10:56:183
203499140,10cyclictest30817-21/usr/sbin/munin08:10:203
203499140,10cyclictest28481-21sh10:20:043
203499140,10cyclictest28462-21/usr/sbin/munin08:05:143
203499140,10cyclictest28300-21/usr/sbin/munin12:25:143
203499140,10cyclictest26081-21ps09:05:193
203499140,10cyclictest26076-21rm11:47:123
203499140,10cyclictest24859-21gltestperf10:00:143
203499140,10cyclictest23738-21/usr/sbin/munin07:55:163
203499140,10cyclictest23223-21/usr/sbin/munin11:10:143
203499140,10cyclictest2284-21/usr/sbin/munin07:10:103
203499140,10cyclictest22557-21sh10:51:343
203499140,10cyclictest22028-21head07:50:153
203499140,10cyclictest19224-21ssh12:20:043
203499140,10cyclictest19216-21sh09:56:593
203499140,10cyclictest17970-21diskmemload09:21:353
203499140,10cyclictest17794-21ssh11:25:023
203499140,10cyclictest16851-21sh12:36:173
203499140,10cyclictest16164-21proc_pri10:30:213
203499140,10cyclictest15858-21sh12:00:033
203499140,10cyclictest1387-21sh10:05:123
203499140,10cyclictest13447-21sh10:46:353
203499140,10cyclictest12634-21/usr/sbin/munin11:40:143
203499140,10cyclictest11459-21ssh11:21:003
203499140,10cyclictest10104-21sh09:17:483
202999149,4cyclictest25867-21ssh10:53:512
202999149,2cyclictest171rcu_preempt11:05:202
202999146,6cyclictest807-21postgres11:40:372
202999146,6cyclictest24367-21expr07:55:152
202999145,7cyclictest1211-21fschecks_count10:40:152
202999143,6cyclictest21858-21sed09:00:012
202999142,7cyclictest15060-21basename09:20:172
202999142,6cyclictest10214-21sh09:35:142
202999141,9cyclictest7432-21sh09:16:002
202999141,9cyclictest5598-21sh10:07:102
202999141,9cyclictest23059-21runrttasks07:50:382
202999141,9cyclictest17247-21/usr/sbin/munin08:50:132
202999141,10cyclictest7775-21latency_hist08:30:012
202999141,10cyclictest24362-21tr10:35:132
2029991410,3cyclictest31185-21sh11:32:022
202999140,8cyclictest28777-21wget10:20:112
202999140,6cyclictest6836-21ssh11:36:212
202999140,11cyclictest15640-21if_enp5s008:45:162
202999140,10cyclictest831-21runrttasks12:27:122
202999140,10cyclictest5597-21/usr/sbin/munin09:50:202
202999140,10cyclictest4669-21sh12:30:052
202999140,10cyclictest32317-21wget11:15:142
202999140,10cyclictest30640-21ssh09:11:072
202999140,10cyclictest30599-21ssh11:50:102
202999140,10cyclictest29785-21sh09:28:142
202999140,10cyclictest29452-21chrt12:07:102
202999140,10cyclictest29340-21wc08:05:162
202999140,10cyclictest27653-21ssh10:01:242
202999140,10cyclictest26483-21diskmemload11:11:212
202999140,10cyclictest2638-21df07:10:092
202999140,10cyclictest22859-21ssh09:41:342
202999140,10cyclictest22299-21ssh11:45:152
202999140,10cyclictest19556-21wget10:15:112
202999140,10cyclictest17919-21sh11:25:072
202999140,10cyclictest15763-21ssh10:12:512
202999140,10cyclictest15758-21sh12:35:302
202999140,10cyclictest14880-21ssh11:59:362
202999140,10cyclictest14263-21ssh11:22:572
202999140,10cyclictest13682-21sh12:16:232
202999140,10cyclictest10741-21latency10:45:162
202599144,5cyclictest26010-21sh11:11:011
202599142,7cyclictest32-21ksoftirqd/110:28:141
202599141,8cyclictest32-21ksoftirqd/111:34:551
202599141,8cyclictest16452-21sh09:20:361
202599141,10cyclictest12852-21ssh11:21:591
202599140,9cyclictest17399-21diskmemload11:42:281
202599140,8cyclictest32-21ksoftirqd/112:15:521
202599140,8cyclictest32-21ksoftirqd/109:32:131
202599140,8cyclictest32-21ksoftirqd/109:15:121
202599140,10cyclictest831-21runrttasks08:34:111
202599140,10cyclictest744-21snmpd09:35:501
202599140,10cyclictest7414-21runrttasks08:28:591
202599140,10cyclictest5489-21sed07:15:161
202599140,10cyclictest29623-21rm09:10:281
202599140,10cyclictest24189-21fschecks_time09:25:141
202599140,10cyclictest2318-21unixbench_multi08:15:241
202599140,10cyclictest21665-21cpuspeed_turbos07:50:131
202599140,10cyclictest21090-21munin-run07:50:001
202599140,10cyclictest20668-21ntpq10:15:171
202599140,10cyclictest17637-21cp11:25:011
202599140,10cyclictest17239-21apt08:50:121
202599140,10cyclictest14886-21/usr/sbin/munin08:45:151
202599140,10cyclictest14125-21/usr/sbin/munin11:05:201
202599140,10cyclictest11724-21/usr/sbin/munin07:30:131
202599140,10cyclictest11181-21runrttasks07:27:311
202599140,10cyclictest10629-21tr10:10:141
202599140,10cyclictest10296-21chrt09:52:151
202099146,6cyclictest9165-21ps10:26:390
202099146,6cyclictest3635-21ssh11:16:470
202099145,7cyclictest831-21runrttasks09:40:330
202099145,7cyclictest30057-21basename10:20:180
202099145,7cyclictest13504-21sshd07:32:070
202099145,3cyclictest0-21swapper/012:25:110
202099144,5cyclictest17895-21swap07:40:250
202099143,8cyclictest18846-21timerwakeupswit08:50:240
202099143,7cyclictest21395-21vmstat10:15:230
202099142,9cyclictest7332-21grep11:55:120
202099141,9cyclictest1057-21sh09:47:160
202099141,6cyclictest28048-21/usr/sbin/munin10:55:100
202099141,12cyclictest9825-21apt-get10:45:110
202099140,7cyclictest25896-21/usr/sbin/munin10:35:250
202099140,5cyclictest10192-21df09:35:140
202099140,12cyclictest18749-21ssh10:50:020
202099140,12cyclictest1504-21hddtemp_smartct10:40:160
202099140,11cyclictest27938-21taskset08:02:450
202099140,11cyclictest175-1kworker/0:1H+kblockd07:23:280
202099140,10cyclictest831-21runrttasks10:04:140
202099140,10cyclictest7548-21diskmemload09:16:050
202099140,10cyclictest6847-21ssh12:12:480
202099140,10cyclictest29187-21ssh11:49:230
202099140,10cyclictest2624-21ssh09:30:330
202099140,10cyclictest23649-21diskstats11:10:160
202099140,10cyclictest2288-21unixbench-2d08:15:240
202099140,10cyclictest21878-21fschecks_time07:50:150
202099140,10cyclictest20131-21taskset07:45:220
202099140,10cyclictest18877-21rm10:31:500
202099140,10cyclictest16930-21cron08:50:000
202099140,10cyclictest11944-21sh11:21:200
658399131,10tDemoTimingTask8826-21chrt07:22:285
203699134,7cyclictest25341-21grep07:55:254
203699133,6cyclictest14753-21kworker/u24:3+xprtiod11:05:014
203699132,8cyclictest6228-21unixbench_singl07:15:224
203699131,9cyclictest14886-21/usr/sbin/munin08:45:124
203699130,9cyclictest864-21runintdemo5min07:49:244
203699130,9cyclictest5504-21/usr/sbin/munin08:25:204
203699130,9cyclictest4879-21sh11:00:044
203699130,9cyclictest3145-21/usr/sbin/munin08:20:154
203699130,9cyclictest3145-21/usr/sbin/munin08:20:154
203699130,9cyclictest30659-21/usr/sbin/munin11:50:144
203699130,9cyclictest28479-21/usr/sbin/munin10:55:134
203699130,9cyclictest2813-21runrttasks08:19:584
203699130,9cyclictest14784-21sh09:55:084
203699130,9cyclictest14241-21/usr/sbin/munin09:20:144
203699130,9cyclictest12298-21ssh09:35:484
203699130,9cyclictest11260-21runrttasks07:28:384
203699130,10cyclictest3499-21ssh11:35:084
203699130,10cyclictest32053-21ssh09:12:044
203699130,10cyclictest3025-21cat07:10:124
203699130,10cyclictest28758-21/usr/sbin/munin09:45:204
203699130,10cyclictest26856-21rm11:30:074
203699130,10cyclictest2118-21cat07:10:004
203699130,10cyclictest12607-21sh12:15:364
203499132,8cyclictest5593-21grep08:25:163
203499130,9cyclictest20393-21xargs07:45:263
203499130,10cyclictest20124-21tune2fs08:55:143
202999130,9cyclictest7852-21/usr/sbin/munin08:30:122
202999130,9cyclictest744-21snmpd08:23:142
202999130,9cyclictest744-21snmpd08:23:132
202999130,9cyclictest6333-21runrttasks07:15:522
202999130,9cyclictest26821-21if_enp5s008:00:162
202999130,9cyclictest22163-21apt-key09:00:012
202999130,9cyclictest19218-21ssh12:20:032
202999130,9cyclictest16624-21fschecks_time12:00:162
202999130,9cyclictest14458-21chrt08:43:272
202999130,9cyclictest11724-21/usr/sbin/munin07:30:212
202999130,9cyclictest1163-21fschecks_count08:15:142
202999130,9cyclictest10954-21grep07:25:252
202999130,9cyclictest10209-21/usr/sbin/munin08:35:182
202999130,10cyclictest19036-21/usr/sbin/munin07:45:152
202999130,10cyclictest18467-21runrttasks07:42:082
202599130,9cyclictest831-21runrttasks07:56:411
202599130,9cyclictest3145-21/usr/sbin/munin08:20:231
202599130,9cyclictest3145-21/usr/sbin/munin08:20:231
202599130,9cyclictest27177-21ntp_offset08:00:181
202599130,9cyclictest19640-21runrttasks08:55:101
202599130,10cyclictest831-21runrttasks08:35:581
202599130,10cyclictest4019-21runrttasks07:11:241
202599130,10cyclictest29634-21grep08:05:191
202099135,6cyclictest4667-21aten2_r5power_c07:15:110
202099133,7cyclictest175-1kworker/0:1H+kblockd08:05:180
202099131,10cyclictest2203-21cat07:10:000
202099130,9cyclictest15034-21runrttasks07:35:200
202099130,7cyclictest864-21runintdemo5min08:55:180
202099130,7cyclictest175-1kworker/0:1H+kblockd07:56:260
202099130,7cyclictest1-21systemd08:33:050
202099130,11cyclictest32158-21python311:50:240
202099130,10cyclictest9995-21sed07:25:150
202099130,10cyclictest744-21snmpd07:10:030
202099130,10cyclictest5592-21wget08:25:160
202099130,10cyclictest11977-21taskset08:37:000
1770629130,2tAtEmLog_0191922sleep511:43:405
723539120,0EcMasterDemoSyn0-21swapper/512:13:055
3159599120,10tDemoTimingTask1576-21chrt07:05:245
301339120,0EcMasterDemoSyn0-21swapper/509:30:495
2684529121,9tAtEmLog_02352-21chrt11:51:595
2158229120,2tAtEmLog_024808-21taskset12:05:015
2099239120,9EcMasterDemoSyn23170-21chrt07:52:105
203699120,9cyclictest7004-21date07:20:004
203699120,9cyclictest28462-21/usr/sbin/munin08:05:234
1491099120,10tDemoTimingTask15266-21chrt08:45:135
1341629120,2tAtEmLog_015302-21taskset11:23:415
935929110,1tAtEmLog_0177682sleep511:06:405
858899110,9tDemoTimingTask9822-21chrt11:38:265
679639110,0EcMasterDemoSyn0-21swapper/509:15:365
3044339110,0EcMasterDemoSyn0-21swapper/508:09:415
2974239110,0EcMasterDemoSyn0-21swapper/509:10:325
2774539110,0EcMasterDemoSyn0-21swapper/511:12:145
276339110,0EcMasterDemoSyn0-21swapper/508:19:505
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional