You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-01 - 00:22
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Wed Dec 31, 2025 12:43:56)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1219239920,0EcMasterDemoSyn1220229tAtEmLog_008:51:385
1104639920,0EcMasterDemoSyn1105629tAtEmLog_011:28:515
885739910,0EcMasterDemoSyn886729tAtEmLog_007:35:355
407339910,0EcMasterDemoSyn408329tAtEmLog_007:25:265
3168539830,0EcMasterDemoSyn3169529tAtEmLog_012:34:465
2435739830,0EcMasterDemoSyn2436729tAtEmLog_009:11:555
227839830,0EcMasterDemoSyn228829tAtEmLog_009:52:295
1928839830,0EcMasterDemoSyn1929829tAtEmLog_009:06:515
151239830,0EcMasterDemoSyn152229tAtEmLog_009:17:005
742639820,0EcMasterDemoSyn743629tAtEmLog_008:41:305
610739820,0EcMasterDemoSyn611729tAtEmLog_010:12:465
313739820,0EcMasterDemoSyn314729tAtEmLog_010:48:165
3032939820,0EcMasterDemoSyn3033929tAtEmLog_008:21:135
2001339820,0EcMasterDemoSyn2002329tAtEmLog_011:33:545
1613739820,0EcMasterDemoSyn1614729tAtEmLog_011:13:375
2549339810,0EcMasterDemoSyn2550329tAtEmLog_009:47:255
1143039810,0EcMasterDemoSyn1144029tAtEmLog_009:57:345
227839700,0EcMasterDemoSyn2287-21runintdemo5min09:52:292
115182510,0sleep10-21swapper/109:57:371
3032939250,0EcMasterDemoSyn0-21swapper/008:21:130
978339200,0EcMasterDemoSyn9792-21wc08:46:344
2718499195,10cyclictest831-21runrttasks09:54:590
27198991814,3cyclictest8476-21unixbench_singl09:55:283
27198991810,6cyclictest1695-21sed11:05:163
2718499184,10cyclictest23001-21sh12:29:490
2718499180,14cyclictest8844-21sh09:38:530
2718499180,14cyclictest30168-21sh11:20:530
2718499180,14cyclictest23224-21sh09:11:100
2718499180,14cyclictest18268-21sh10:38:290
2718499180,14cyclictest13879-21sh12:05:370
2718499180,10cyclictest31008-21sh11:03:570
2002499180,7tDemoTimingTask24240-21chrt11:35:305
453829170,7tAtEmLog_07206-21chrt12:20:205
2945299170,10tDemoTimingTask1460-21chrt09:35:005
2782099170,10tDemoTimingTask28896-21chrt12:15:015
2719899175,8cyclictest327-21systemd-journal10:49:193
2719899171,12cyclictest16-1pr/legacy09:42:203
2719899170,9cyclictest29086-21fschecks_time08:20:143
2719399171,12cyclictest16-1pr/legacy11:28:502
2719399170,10cyclictest28603-21/usr/sbin/munin08:20:122
2718499171,9cyclictest175-1kworker/0:1H+kblockd09:40:350
2718499170,9cyclictest3929-21chrt10:48:500
2718499170,9cyclictest22246-21kworker/u24:0+flush-9:011:26:080
2718499170,9cyclictest14572-21taskset09:59:510
2718499170,9cyclictest13291-21sh11:47:430
2718499170,7cyclictest175-1kworker/0:1H+kblockd10:41:180
1782739170,0EcMasterDemoSyn0-21swapper/510:38:085
3087699160,9tDemoTimingTask31107-21taskset07:15:215
2720199161,9cyclictest744-21snmpd09:22:454
2720199160,9cyclictest4307-21/usr/sbin/munin11:25:154
27198991612,3cyclictest6420-21gltestperf12:20:153
2719899160,10cyclictest31927-21ssh10:27:433
2719899160,10cyclictest21699-21sh10:58:453
2719399160,9cyclictest23287-21ssh12:11:102
2719399160,9cyclictest23287-21ssh12:11:092
2718499165,8cyclictest27448-21readlink08:15:210
2718499165,8cyclictest27448-21readlink08:15:210
2718499165,8cyclictest21909-21sh11:16:180
2718499165,7cyclictest6910-21mailstats08:40:190
2718499160,9cyclictest831-21runrttasks07:43:420
2718499160,8cyclictest7823-21mailstats09:20:200
1614899160,9tDemoTimingTask18436-21chrt11:15:005
2925899152,10tDemoTimingTask4193-21chrt11:42:435
2720199151,12cyclictest21841-21ssh12:29:014
2720199150,10cyclictest13823-21sh09:59:144
2719899156,7cyclictest32199-21sensors08:25:223
27198991511,3cyclictest25424-21fschecks_time09:30:163
2719899151,11cyclictest14303-21sh11:48:263
2719899151,10cyclictest27171-21ssh09:48:333
2719899150,11cyclictest3645-21irqstats12:00:163
2719899150,11cyclictest347-21sort11:05:003
2719399154,8cyclictest16346-21smartctl12:25:252
2719399151,10cyclictest8495-21sh10:50:392
2719399151,10cyclictest831-21runrttasks07:13:362
2719399151,10cyclictest3389-21/usr/sbin/munin10:30:192
2719399151,10cyclictest31275-21ssh12:34:292
2719399150,9cyclictest22567-21taskset09:28:502
2719399150,9cyclictest10010-21runrttasks08:48:292
2719399150,11cyclictest27898-21runrttasks08:15:402
2719399150,11cyclictest27898-21runrttasks08:15:392
2719399150,11cyclictest26270-21/usr/sbin/munin11:55:172
2719399150,11cyclictest19804-21ssh11:15:182
2719399150,11cyclictest13497-21ssh09:40:312
2718999155,8cyclictest13031-21/usr/sbin/munin10:35:171
2718999150,11cyclictest28943-21sh11:55:571
2718499156,7cyclictest1386-21df11:05:130
2718499153,8cyclictest32226-21latency_hist07:20:000
2718499153,10cyclictest420-21cat11:40:240
2718499152,9cyclictest29528-21diskmemload11:56:210
2718499150,9cyclictest831-21runrttasks07:53:280
2718499150,11cyclictest16115-21sh10:55:190
1692739150,9EcMasterDemoSyn14855-21sleep09:04:555
611729140,4tAtEmLog_0100152sleep510:15:155
2720199146,6cyclictest31835-21seq08:25:184
2720199145,7cyclictest7213-21smartctl12:20:214
2720199141,9cyclictest15001-21ssh12:06:274
2720199141,10cyclictest6390-21ssh09:37:134
2720199141,10cyclictest21385-21sh10:03:184
2720199141,10cyclictest21385-21sh10:03:184
2720199140,9cyclictest29356-21ssh09:32:104
2720199140,10cyclictest831-21runrttasks07:32:214
2720199140,10cyclictest5971-21latency_hist09:55:004
2720199140,10cyclictest4220-21ssh11:42:444
2720199140,10cyclictest32300-21cmp07:20:004
2720199140,10cyclictest28110-21ssh12:14:414
2720199140,10cyclictest28110-21ssh12:14:404
2720199140,10cyclictest27233-21ssh10:43:354
2720199140,10cyclictest26524-21sh11:19:374
2720199140,10cyclictest25145-21ssh09:47:114
2720199140,10cyclictest22610-21diskstats11:35:164
2720199140,10cyclictest20668-21ssh10:58:034
2720199140,10cyclictest16889-21/usr/sbin/munin07:55:114
2720199140,10cyclictest16072-21ssh10:18:444
2720199140,10cyclictest15404-21ssh10:36:254
2720199140,10cyclictest1279-21sh11:59:224
2720199140,10cyclictest10509-21apt-get09:40:004
2719899147,6cyclictest27773-21smartctl11:55:243
2719899146,6cyclictest14192-21grep08:55:273
2719899142,9cyclictest11639-21apt-get12:05:123
2719899141,9cyclictest831-21runrttasks07:10:233
2719899141,9cyclictest25753-21runrttasks08:12:543
2719899141,9cyclictest17510-21runrttasks09:05:103
2719899141,9cyclictest1382-21ssh09:16:553
2719899141,10cyclictest24451-21sh10:41:343
2719899140,11cyclictest831-21runrttasks07:20:023
2719899140,11cyclictest29584-21ssh12:33:113
2719899140,11cyclictest2863-21sh10:10:313
2719899140,10cyclictest831-21runrttasks08:05:303
2719899140,10cyclictest8261-21tail09:20:243
2719899140,10cyclictest8200-21cpu08:45:153
2719899140,10cyclictest7804-21cat10:50:233
2719899140,10cyclictest7441-21taskset08:41:303
2719899140,10cyclictest7175-21runrttasks07:35:073
2719899140,10cyclictest6494-21runrttasks07:30:303
2719899140,10cyclictest620-21sh11:22:563
2719899140,10cyclictest5734-21/usr/sbin/munin11:25:223
2719899140,10cyclictest3389-21/usr/sbin/munin10:30:263
2719899140,10cyclictest32659-21/usr/sbin/munin12:35:193
2719899140,10cyclictest3216-21chrt09:35:233
2719899140,10cyclictest31468-21grep07:15:233
2719899140,10cyclictest31425-21ssh12:15:403
2719899140,10cyclictest31320-21/usr/sbin/munin11:40:133
2719899140,10cyclictest30146-21grep09:50:123
2719899140,10cyclictest27380-21ssh10:06:113
2719899140,10cyclictest27380-21ssh10:06:103
2719899140,10cyclictest26341-21cpu08:15:133
2719899140,10cyclictest26341-21cpu08:15:133
2719899140,10cyclictest2422-21/usr/sbin/munin07:25:153
2719899140,10cyclictest23724-21sh12:11:283
2719899140,10cyclictest23724-21sh12:11:273
2719899140,10cyclictest22992-21ssh11:35:183
2719899140,10cyclictest21309-21sh11:51:583
2719899140,10cyclictest20219-21/usr/sbin/munin09:10:213
2719899140,10cyclictest18623-21rm11:15:083
2719899140,10cyclictest18414-21/usr/sbin/munin10:20:173
2719899140,10cyclictest17766-21runrttasks12:26:083
2719899140,10cyclictest17036-21cpuspeed_turbos07:55:123
2719899140,10cyclictest16719-21grep09:25:203
2719899140,10cyclictest16341-21fw_packets10:00:173
2719899140,10cyclictest16341-21fw_packets10:00:163
2719899140,10cyclictest15373-21sh11:13:063
2719899140,10cyclictest15163-21/usr/sbin/munin09:00:133
2719899140,10cyclictest14526-21wget07:50:133
2719899140,10cyclictest13329-21/usr/sbin/munin11:30:143
2719899140,10cyclictest12129-21ssh10:35:063
2719899140,10cyclictest11805-21ssh10:15:413
2719399146,6cyclictest19300-21tr10:20:162
2719399143,8cyclictest287-21jbd2/md0-807:35:032
2719399141,9cyclictest24021-21diskmemload11:53:522
2719399141,9cyclictest12519-21sh12:23:492
2719399141,10cyclictest17353-21sh10:19:402
2719399140,9cyclictest24725-21diskmemload10:05:142
2719399140,9cyclictest24725-21diskmemload10:05:132
2719399140,10cyclictest9713-21ssh09:56:232
2719399140,10cyclictest9427-21sh11:10:042
2719399140,10cyclictest8821-21sh11:45:162
2719399140,10cyclictest831-21runrttasks11:09:152
2719399140,10cyclictest831-21runrttasks09:02:202
2719399140,10cyclictest8031-21ssh12:02:492
2719399140,10cyclictest5771-21wget08:40:122
2719399140,10cyclictest4832-21/usr/sbin/munin07:30:212
2719399140,10cyclictest4486-21sh10:11:382
2719399140,10cyclictest32477-21/usr/sbin/munin07:20:172
2719399140,10cyclictest31751-21ssh09:15:302
2719399140,10cyclictest3106-21latency_hist08:35:002
2719399140,10cyclictest30319-21rm12:15:182
2719399140,10cyclictest29798-21/usr/sbin/munin07:15:182
2719399140,10cyclictest28756-21ssh10:25:262
2719399140,10cyclictest27461-21taskset11:20:052
2719399140,10cyclictest26987-21ssh11:01:052
2719399140,10cyclictest26075-21sh09:13:042
2719399140,10cyclictest25907-21ssh11:36:402
2719399140,10cyclictest25484-21perl09:30:162
2719399140,10cyclictest2509-21sh09:35:172
2719399140,10cyclictest24753-21sh09:46:562
2719399140,10cyclictest23865-21/usr/sbin/munin08:10:132
2719399140,10cyclictest2364-21rm11:41:292
2719399140,10cyclictest23318-21ssh10:40:462
2719399140,10cyclictest19428-21taskset09:08:152
2719399140,10cyclictest16784-21/usr/sbin/munin07:55:162
2719399140,10cyclictest16566-21sh10:00:192
2719399140,10cyclictest16566-21sh10:00:182
2719399140,10cyclictest15185-21sh10:55:142
2719399140,10cyclictest1513-21ssh10:47:042
2719399140,10cyclictest14438-21/usr/sbin/munin07:50:262
2719399140,10cyclictest1414-21diskmemload12:35:202
2719399140,10cyclictest13504-21grep12:05:252
2719399140,10cyclictest13350-21fschecks_time08:55:172
2719399140,10cyclictest13025-21rm11:30:002
2719399140,10cyclictest12167-21sh10:35:072
2719399140,10cyclictest11609-21sendmail_mailqu08:50:182
2718999144,7cyclictest2156-21smartctl08:30:211
2718999141,9cyclictest831-21runrttasks12:34:011
2718999141,9cyclictest831-21runrttasks12:07:501
2718999141,9cyclictest7769-21sendmail_mailqu09:20:191
2718999141,9cyclictest27450-21/usr/sbin/munin07:10:241
2718999141,9cyclictest25260-21sh12:12:351
2718999141,9cyclictest25260-21sh12:12:341
2718999141,9cyclictest17140-21runrttasks09:04:091
2718999141,9cyclictest14573-21sh10:17:431
2718999141,9cyclictest12105-21diskmemload10:53:181
2718999141,9cyclictest1066-21munin-node12:00:091
2718999141,10cyclictest27508-21sh10:25:151
2718999141,10cyclictest22126-21python309:45:221
27189991410,3cyclictest864-21runintdemo5min11:33:561
2718999140,12cyclictest32124-21ssh11:04:431
2718999140,10cyclictest9930-21runrttasks08:48:041
2718999140,10cyclictest9615-21/usr/sbin/munin11:10:161
2718999140,10cyclictest9514-21ssh11:27:471
2718999140,10cyclictest744-21snmpd09:30:481
2718999140,10cyclictest7237-21ssh12:39:191
2718999140,10cyclictest6549-21sh11:44:201
2718999140,10cyclictest5574-21sh12:20:041
2718999140,10cyclictest4025-21sh10:11:181
2718999140,10cyclictest3997-21sh11:06:081
2718999140,10cyclictest3614-21sh08:35:141
2718999140,10cyclictest31379-21sh11:21:451
2718999140,10cyclictest30956-21/usr/sbin/munin08:25:201
2718999140,10cyclictest29124-21/usr/sbin/munin12:15:191
2718999140,10cyclictest2841-21sh09:35:181
2718999140,10cyclictest24113-21ssh10:05:021
2718999140,10cyclictest24113-21ssh10:05:021
2718999140,10cyclictest2411-21runrttasks07:25:041
2718999140,10cyclictest21191-21ssh11:51:521
2718999140,10cyclictest19954-21sh10:20:221
2718999140,10cyclictest18872-21sh12:26:551
2718999140,10cyclictest18710-21/usr/sbin/munin11:15:181
2718999140,10cyclictest16035-21tune2fs09:25:151
2718999140,10cyclictest15214-21/usr/sbin/munin10:55:221
2718999140,10cyclictest12373-21sh11:47:051
2718499146,6cyclictest644-21dbus-daemon08:05:200
2718499146,6cyclictest4658-21/usr/sbin/munin10:30:200
2718499145,7cyclictest25809-21ssh12:30:270
2718499145,7cyclictest20019-21switchtime10:20:230
2718499145,7cyclictest18478-21wc11:50:200
2718499143,8cyclictest804-21postgres09:30:200
2718499142,10cyclictest15848-21cpu10:00:130
2718499142,10cyclictest15848-21cpu10:00:130
2718499141,9cyclictest26235-21unixbench_singl10:05:240
2718499141,9cyclictest26235-21unixbench_singl10:05:240
2718499141,9cyclictest12834-21diskmemload10:16:240
2718499141,9cyclictest12620-21fschecks_time07:45:120
2718499140,9cyclictest8864-21runintdemo5min07:35:350
2718499140,9cyclictest831-21runrttasks09:25:320
2718499140,9cyclictest25252-21sh12:12:340
2718499140,9cyclictest25252-21sh12:12:340
2718499140,7cyclictest7207-21/usr/sbin/munin12:20:190
2718499140,7cyclictest3677-21ssh10:11:060
2718499140,12cyclictest6396-21sh12:01:340
2718499140,12cyclictest22454-21unixbench-2d09:45:240
2718499140,12cyclictest1886-21cat12:35:260
2718499140,10cyclictest8971-21missed_timers08:45:190
2718499140,10cyclictest831-21runrttasks07:20:110
2718499140,10cyclictest7582-21mailstats10:50:200
2718499140,10cyclictest31313-21df_inode08:25:140
2718499140,10cyclictest29625-21sh09:15:080
2718499140,10cyclictest29089-21sh10:25:310
2718499140,10cyclictest23443-21ntp_offset11:35:200
2718499140,10cyclictest1977-21diskmemload12:17:480
2718499140,10cyclictest175-1kworker/0:1H+kblockd07:34:270
2718499140,10cyclictest16368-21sh11:31:180
2718499140,10cyclictest15507-21cstates09:00:140
2718499140,10cyclictest12724-21ssh11:11:150
3169529130,11tAtEmLog_02335-21taskset12:35:405
2720199139,3cyclictest3649-21cpuspeed_turbos10:30:144
2720199135,6cyclictest6096-21ssh10:50:084
2720199131,9cyclictest868-21fschecks_time12:35:174
2720199131,9cyclictest31771-21diskmemload09:15:304
2720199130,9cyclictest9732-21/usr/sbin/munin07:40:184
2720199130,9cyclictest831-21runrttasks08:09:424
2720199130,9cyclictest3678-21taskset07:25:234
2720199130,9cyclictest327-21systemd-journal11:10:204
2720199130,9cyclictest3254-21/usr/sbin/munin08:35:194
2720199130,9cyclictest30586-21sh12:15:204
2720199130,9cyclictest3045-21sh10:10:394
2720199130,9cyclictest30443-21taskset08:22:164
2720199130,9cyclictest29798-21/usr/sbin/munin07:15:234
2720199130,9cyclictest29711-21ssh10:45:094
2720199130,9cyclictest28556-21latency_hist08:20:004
2720199130,9cyclictest28556-21latency_hist08:20:004
2720199130,9cyclictest28548-21rm10:25:244
2720199130,9cyclictest27560-21rm11:20:114
2720199130,9cyclictest2618-21sh12:00:044
2720199130,9cyclictest25293-21latency10:05:174
2720199130,9cyclictest25293-21latency10:05:174
2720199130,9cyclictest24200-21/usr/sbin/munin08:10:124
2720199130,9cyclictest24131-21ssh09:11:464
2720199130,9cyclictest23797-21ssh12:30:124
2720199130,9cyclictest22968-21rm10:22:244
2720199130,9cyclictest17567-21aten2_r5power_e09:05:114
2720199130,9cyclictest17020-21sh11:50:054
2720199130,9cyclictest15460-21ssh09:25:074
2720199130,9cyclictest15163-21/usr/sbin/munin09:00:154
2720199130,9cyclictest14438-21/usr/sbin/munin07:50:164
2720199130,9cyclictest13170-21ssh11:30:064
2720199130,9cyclictest13169-21fschecks_count08:55:164
2720199130,9cyclictest12081-21/usr/sbin/munin07:45:114
2720199130,9cyclictest10556-21/usr/sbin/munin08:50:114
2720199130,9cyclictest10139-21taskset11:45:314
2720199130,8cyclictest1454-21perl08:30:154
2720199130,10cyclictest7121-21wc08:40:234
2720199130,10cyclictest25527-21mailstats11:00:214
2720199130,10cyclictest1735-21hddtemp_smartct11:05:164
2719899135,6cyclictest19427-21expr08:00:143
2719899133,6cyclictest27217-21latency_hist07:10:003
2719899130,9cyclictest9849-21aten2_r5power_v07:40:113
2719899130,9cyclictest893-21/usr/sbin/munin08:30:153
2719899130,9cyclictest10896-21tune2fs08:50:133
2719899130,10cyclictest12480-21fschecks_count07:45:123
2719399130,9cyclictest6178-21ssh09:20:022
2719399130,9cyclictest3254-21/usr/sbin/munin08:35:202
2719399130,9cyclictest3231-21latency07:25:182
2719399130,9cyclictest30961-21apt-get08:25:132
2719399130,9cyclictest12618-21fschecks_time07:45:122
2719399130,9cyclictest11492-21runrttasks07:41:102
2719399130,10cyclictest21516-21/usr/sbin/munin08:05:132
2719399130,10cyclictest19752-21expr08:00:172
2718999132,8cyclictest22275-21tr11:35:141
2718999131,9cyclictest29882-21ssh10:45:121
2718999131,9cyclictest16813-21aten2_r5power_c07:55:111
2718999130,9cyclictest7181-21/usr/sbin/munin07:35:131
2718999130,9cyclictest6788-21runrttasks07:33:521
2718999130,9cyclictest32680-21cpuspeed_turbos07:20:121
2718999130,9cyclictest32650-21ssh09:50:591
2718999130,9cyclictest30334-21perl09:15:151
2718999130,9cyclictest29798-21/usr/sbin/munin07:15:121
2718999130,9cyclictest27823-21unixbench_singl08:15:251
2718999130,9cyclictest27823-21unixbench_singl08:15:251
2718999130,9cyclictest24531-21hddtemp_smartct08:10:141
2718999130,9cyclictest21995-21grep09:10:271
2718999130,9cyclictest21516-21/usr/sbin/munin08:05:241
2718999130,9cyclictest19164-21apt08:00:121
2718999130,9cyclictest16235-21taskset07:51:421
2718999130,9cyclictest15444-21ssh10:00:031
2718999130,9cyclictest15444-21ssh10:00:021
2718999130,9cyclictest13518-21/usr/sbin/munin08:55:181
2718999130,9cyclictest12438-21df_inode07:45:111
2718999130,9cyclictest11016-21gltestperf08:50:131
2718999130,9cyclictest10802-21ntp_offset07:40:171
2718999130,10cyclictest7853-21cat08:45:001
2718999130,10cyclictest3409-21ssh10:30:131
2718999130,10cyclictest30371-21runrttasks08:21:171
2718999130,10cyclictest20867-21/usr/sbin/munin10:40:181
2718999130,10cyclictest18182-21sh09:05:141
2718999130,10cyclictest11377-21sh09:40:111
2718499134,7cyclictest24534-21/usr/sbin/munin08:10:140
2718499130,9cyclictest831-21runrttasks07:55:050
2718499130,9cyclictest2659-21cut07:25:140
2718499130,9cyclictest20053-21missed_timers08:00:180
2718499130,9cyclictest19106-21/usr/sbin/munin09:05:230
2718499130,9cyclictest12814-21aten2_r5power_c08:55:140
2718499130,9cyclictest11305-21load08:50:150
2718499130,7cyclictest175-1kworker/0:1H+kblockd07:14:550
2718499130,10cyclictest2210-21/usr/sbin/munin08:30:230
2718499130,10cyclictest175-1kworker/0:1H+kblockd08:36:320
2449799130,7tDemoTimingTask32089-21taskset11:58:165
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional