You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-27 - 18:58
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Fri Mar 27, 2026 12:44:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
90239840,0EcMasterDemoSyn91529tAtEmLog_010:15:095
2929439840,0EcMasterDemoSyn2930429tAtEmLog_011:05:525
3218839830,0EcMasterDemoSyn3219829tAtEmLog_012:37:095
3213639830,0EcMasterDemoSyn3214629tAtEmLog_008:43:525
2854039830,0EcMasterDemoSyn2855029tAtEmLog_007:27:495
2029839830,0EcMasterDemoSyn2030829tAtEmLog_008:18:315
587939820,0EcMasterDemoSyn588929tAtEmLog_009:24:265
2740039820,0EcMasterDemoSyn2741029tAtEmLog_008:33:445
1557139820,0EcMasterDemoSyn1558129tAtEmLog_008:08:235
582139810,0EcMasterDemoSyn583129tAtEmLog_007:48:065
2819839810,0EcMasterDemoSyn2820829tAtEmLog_012:16:515
209852410,1sleep120986-21ssh10:44:031
19068992522,2cyclictest974-21kworker/2:2+events12:11:462
1905999230,14cyclictest27877-21cut10:30:010
1905999221,9cyclictest1292-21sh12:02:180
2314599210,11tDemoTimingTask23159-21chrt12:32:045
1905999216,7cyclictest32420-21sh10:50:150
1905999210,9cyclictest12567-21sh10:20:430
1905999210,14cyclictest19601-21ssh10:07:050
1905999205,7cyclictest12875-21/usr/sbin/munin09:45:230
1905999201,9cyclictest16363-21sh10:40:400
1905999200,9cyclictest17998-21cpuspeed_turbos11:00:110
1905999200,9cyclictest11950-21sh12:25:310
1905999200,7cyclictest28603-21readlink12:00:010
1905999200,7cyclictest27461-21latency_hist12:35:010
1905999200,7cyclictest2665-21ssh11:27:190
1905999200,12cyclictest27726-21sh09:54:200
1905999200,11cyclictest10418-21sh10:37:550
1905999196,6cyclictest19395-21sh09:14:030
1905999194,8cyclictest28348-21sshd12:35:130
1905999194,7cyclictest12043-21ssh09:27:240
1905999191,9cyclictest780-21runrttasks09:37:460
1905999190,9cyclictest32315-21sh09:55:570
1905999190,9cyclictest29365-21runrttasks11:05:550
1905999190,9cyclictest18688-21sh11:35:540
1905999190,9cyclictest11689-21diskmemload11:32:060
1905999190,9cyclictest10189-21sh11:13:500
1905999190,8cyclictest8527-21sh10:00:360
1905999190,8cyclictest8527-21sh10:00:360
1905999190,8cyclictest7817-21sh10:18:470
1905999190,8cyclictest29666-21sh12:17:530
1905999190,8cyclictest26581-21sh09:17:400
1905999190,8cyclictest17249-21diskmemload11:53:370
1905999190,7cyclictest8195-21ssh11:48:360
1905999190,7cyclictest14016-21chrt12:09:440
1905999190,7cyclictest14016-21chrt12:09:430
1905999190,6cyclictest18677-21ssh11:18:290
1905999190,6cyclictest16945-21fschecks_time09:30:150
1905999190,12cyclictest780-21runrttasks07:50:320
1905999190,12cyclictest26457-21sh11:22:340
1905999190,11cyclictest26902-21unixbench_multi11:40:230
1905999190,10cyclictest5581-21head08:55:150
1905999190,10cyclictest31106-21latency_hist07:35:000
17852190,0sleep10-21swapper/111:26:411
1905999185,6cyclictest174-1kworker/0:1H+kblockd10:55:140
1905999185,5cyclictest29446-21/usr/sbin/munin10:30:190
1905999184,6cyclictest32478-21cut08:45:010
1905999184,6cyclictest26015-21fschecks_time08:30:160
1905999184,6cyclictest20610-21grep07:10:180
1905999183,7cyclictest174-1kworker/0:1H+kblockd07:59:250
1905999183,6cyclictest18943-21fschecks_time08:15:140
1905999181,7cyclictest3104-21missed_timers09:40:170
1905999180,9cyclictest21710-21sh12:13:500
1905999180,9cyclictest1485-21gltestperf12:20:140
1905999180,9cyclictest1223-21ntp_offset08:45:170
1905999180,8cyclictest4402-21cut07:45:130
1905999180,8cyclictest4350-21runrttasks08:52:540
1905999180,8cyclictest25352-21missed_timers10:10:190
1905999180,8cyclictest24964-21runrttasks08:27:460
1905999180,8cyclictest22748-21diskmemload10:45:040
1905999180,7cyclictest18101-21munin-run08:15:000
1905999180,6cyclictest1071-21taskset07:38:040
1905999180,6cyclictest1041-21ssh09:21:050
1905999180,10cyclictest11649-21expr08:00:110
848899170,15tDemoTimingTask8974-21chrt07:55:125
506799170,10tDemoTimingTask5072-21chrt11:46:265
2853799170,8tDemoTimingTask920-21taskset09:56:415
2414429170,10tAtEmLog_032679-21chrt10:14:555
2027799170,7tDemoTimingTask26190-21chrt10:28:575
1907199171,9cyclictest24876-21ssh11:21:273
1905999174,6cyclictest27317-21expr07:25:150
1905999170,9cyclictest24618-21cpuspeed_turbos07:20:120
1905999170,8cyclictest9676-21wget09:05:110
1905999170,8cyclictest22931-21needreboot07:15:170
1905999170,8cyclictest21536-21kernelversion08:20:150
1905999170,7cyclictest174-1kworker/0:1H+kblockd08:05:280
1905999170,10cyclictest174-1kworker/0:1H+kblockd07:44:570
1404499171,9tDemoTimingTask14173-21chrt12:27:045
99499160,9tDemoTimingTask1008-21chrt11:26:105
848899160,14tDemoTimingTask8593-21chrt07:54:125
562199160,7tDemoTimingTask12918-21taskset10:03:415
562199160,7tDemoTimingTask12918-21taskset10:03:415
2973729160,7tAtEmLog_0529-21chrt10:32:235
2741199160,9tDemoTimingTask27831-21taskset08:35:015
2422829160,9tAtEmLog_015791-21sleep09:34:565
2145299160,9tDemoTimingTask21483-21chrt07:12:405
2017599160,10tDemoTimingTask20291-21taskset11:00:515
1907599160,9cyclictest13021-21sh11:50:394
1907599160,7cyclictest1180850latency_hist11:15:004
19071991612,3cyclictest11022-21idleruntime-cro08:00:013
1907199160,9cyclictest30412-21/usr/sbin/munin11:25:163
1906899165,6cyclictest27285-21cron12:35:012
1905999160,8cyclictest780-21runrttasks09:02:300
1023729160,9tAtEmLog_010262-21chrt09:44:445
1907599157,6cyclictest11546-21cut10:20:194
1907599154,8cyclictest27141-21vmstat08:30:264
1907599150,9cyclictest14354-21ssh11:15:264
1907199154,8cyclictest728-21lldpd11:40:063
19071991513,2cyclictest24560-21kworker/3:0+events09:29:293
1907199151,11cyclictest16-1pr/legacy09:44:433
1907199151,10cyclictest6884-21ssh11:11:293
1907199151,10cyclictest20285-21needreboot10:25:173
1907199151,10cyclictest18749-21ssh12:30:073
1907199151,10cyclictest12859-21ssh10:20:563
1907199150,9cyclictest7492-21ssh11:48:063
1907199150,9cyclictest24344-21/usr/sbin/munin07:20:163
1907199150,9cyclictest14075-21rm11:51:233
1907199150,11cyclictest3572-21ssh10:15:523
1906899152,10cyclictest3520-21ssh09:58:302
1906899152,10cyclictest1209-21sh12:02:162
1906899151,9cyclictest731-21sshd10:29:342
1906899151,10cyclictest3547-21runrttasks07:44:232
1906899151,10cyclictest2510-21/usr/sbin/munin08:50:192
1906899151,10cyclictest18185-21sh11:18:072
1906899151,10cyclictest17330-21ssh11:53:412
1906899150,9cyclictest5034-21ssh12:22:002
1906899150,9cyclictest17908-21switchtime09:30:252
1906899150,11cyclictest30216-21/usr/sbin/munin08:40:242
1906899150,10cyclictest22835-21latency_hist08:25:012
1906899150,10cyclictest13969-21ssh12:26:562
1906399158,5cyclictest7208-21tail07:50:161
1906399157,6cyclictest28249-21grep07:25:261
1906399157,6cyclictest12688-21grep11:15:121
1906399154,8cyclictest15332-21vmstat08:05:251
1906399153,8cyclictest9766-21cpu09:05:121
1906399153,8cyclictest648-21dbus-daemon08:10:201
1906399153,8cyclictest4400-21tune2fs07:45:131
1906399151,10cyclictest25490-21/usr/sbin/munin08:30:171
1906399151,10cyclictest1441-21ssh10:15:141
1906399150,9cyclictest8421-21sh10:00:331
1906399150,9cyclictest8421-21sh10:00:321
1159599150,12tDemoTimingTask18094-21chrt09:13:085
975929140,7tAtEmLog_012571-21taskset12:08:435
975929140,7tAtEmLog_012571-21taskset12:08:425
1907599143,8cyclictest716-21snmpd08:18:334
1907599143,8cyclictest17727-21processes09:30:224
1907599141,9cyclictest780-21runrttasks12:05:514
1907599141,9cyclictest780-21runrttasks12:05:514
1907599141,9cyclictest780-21runrttasks10:28:254
1907599141,9cyclictest30135-21latency_hist09:20:014
1907599141,9cyclictest1757-21rm11:26:404
19075991411,2cyclictest18128-21fschecks_count11:00:134
1907599140,11cyclictest14039-21ssh10:57:514
1907599140,10cyclictest780-21runrttasks09:57:084
1907599140,10cyclictest7706-21ssh11:48:144
1907599140,10cyclictest716-21snmpd08:03:274
1907599140,10cyclictest3885-21sendmail-msp12:40:014
1907599140,10cyclictest3434-21sh12:20:544
1907599140,10cyclictest3171-21sh10:15:344
1907599140,10cyclictest31024-21sh11:07:044
1907599140,10cyclictest30492-21/usr/sbin/munin09:20:114
1907599140,10cyclictest30263-21sh10:30:274
1907599140,10cyclictest28791-21cat07:30:004
1907599140,10cyclictest25832-21ssh10:10:224
1907599140,10cyclictest22871-21sh12:31:534
1907599140,10cyclictest19005-21ssh09:13:464
1907599140,10cyclictest15241-21/usr/sbin/munin10:05:154
1907599140,10cyclictest15042-21threads08:05:234
1907599140,10cyclictest14021-21aten2_r5power_e10:40:104
1907599140,10cyclictest10331-21rm11:31:214
1907199141,9cyclictest11334-21/usr/sbin/munin08:00:103
1907199141,10cyclictest24348-21/usr/sbin/munin10:10:143
1907199141,10cyclictest16-1pr/legacy12:37:083
1907199141,10cyclictest15511-21runrttasks08:07:433
1907199141,10cyclictest15447-21/usr/sbin/munin10:05:113
1907199141,10cyclictest13272-21sh10:39:543
1907199140,11cyclictest28785-21taskset09:19:143
1907199140,10cyclictest9734-21runrttasks11:30:583
1907199140,10cyclictest9096-21sh12:06:153
1907199140,10cyclictest9096-21sh12:06:153
1907199140,10cyclictest8435-21sh10:00:323
1907199140,10cyclictest8435-21sh10:00:323
1907199140,10cyclictest7475-21runrttasks12:23:423
1907199140,10cyclictest743-21runrttasks09:20:533
1907199140,10cyclictest3236-21ssh09:58:193
1907199140,10cyclictest31247-21sh10:31:083
1907199140,10cyclictest30703-21sh09:37:463
1907199140,10cyclictest28893-21ssh10:48:143
1907199140,10cyclictest27128-21sh12:16:053
1907199140,10cyclictest26431-21ssh11:58:453
1907199140,10cyclictest21003-21ssh11:01:213
1907199140,10cyclictest20726-21ssh11:37:203
1907199140,10cyclictest19609-21ssh09:31:213
1907199140,10cyclictest19602-21apt-get07:10:013
1907199140,10cyclictest17813-21sh09:48:443
1907199140,10cyclictest14420-21ssh09:10:343
1907199140,10cyclictest14138-21ssh10:40:123
1907199140,10cyclictest13796-21grep11:15:193
1907199140,10cyclictest12666-21sh10:56:533
1907199140,10cyclictest11171-21cut12:25:203
1907199140,10cyclictest11026-21cat09:05:233
1906899146,6cyclictest5129-21tr08:55:132
1906899145,7cyclictest15913-21grep10:05:132
1906899144,8cyclictest29325-21/usr/sbin/munin10:30:182
1906899143,8cyclictest14982-21switchtime08:05:232
1906899141,9cyclictest32633-21sh09:20:312
1906899141,9cyclictest13854-21runrttasks09:45:522
1906899141,10cyclictest11365-21taskset09:06:212
19068991410,3cyclictest326-21systemd-journal12:15:002
1906899140,10cyclictest8473-21sh10:36:312
1906899140,10cyclictest780-21runrttasks11:41:312
1906899140,10cyclictest780-21runrttasks08:17:482
1906899140,10cyclictest7267-21/usr/sbin/munin09:25:192
1906899140,10cyclictest7096-21basename10:00:162
1906899140,10cyclictest7096-21basename10:00:152
1906899140,10cyclictest7069-21wget11:30:112
1906899140,10cyclictest6982-21/usr/sbin/munin07:50:152
1906899140,10cyclictest5969-21/usr/sbin/munin12:05:122
1906899140,10cyclictest5969-21/usr/sbin/munin12:05:112
1906899140,10cyclictest3280-21/usr/sbin/munin11:10:142
1906899140,10cyclictest32594-21ssh11:25:352
1906899140,10cyclictest32546-21fschecks_time10:50:142
1906899140,10cyclictest31079-21chrt12:36:212
1906899140,10cyclictest31002-21runrttasks07:33:452
1906899140,10cyclictest30791-21rm10:13:352
1906899140,10cyclictest29664-21taskset08:37:402
1906899140,10cyclictest26093-21rm09:17:192
1906899140,10cyclictest25840-21ssh11:22:082
1906899140,10cyclictest25320-21ssh09:35:072
1906899140,10cyclictest23534-21cut10:45:132
1906899140,10cyclictest22985-21sh09:50:582
1906899140,10cyclictest2224-21aten2_r5power_v09:40:132
1906899140,10cyclictest21960-21runrttasks07:15:052
1906899140,10cyclictest21460-21grep07:12:372
1906899140,10cyclictest2106-21fschecks_count11:45:152
1906899140,10cyclictest19765-21/usr/sbin/munin11:55:242
1906899140,10cyclictest18010-21rm11:00:112
1906899140,10cyclictest16306-21sh10:40:392
1906899140,10cyclictest16073-21/usr/sbin/munin11:35:212
1906899140,10cyclictest14288-21ssh10:58:022
1906899140,10cyclictest14282-21ssh09:10:282
1906899140,10cyclictest12828-21ssh10:20:552
1906899140,10cyclictest1008-21/usr/sbin/munin10:15:192
1906399148,5cyclictest22091-21tail09:50:231
1906399144,7cyclictest30710-21kworker/u24:0+nfsiod11:20:531
1906399141,9cyclictest29624-21sh12:17:501
1906399141,9cyclictest26679-21ssh10:10:411
1906399141,9cyclictest23203-21ssh11:02:551
19063991411,2cyclictest13135-21kworker/1:1+events09:24:261
1906399141,10cyclictest26530-21sh09:17:381
1906399141,10cyclictest16738-21df09:30:141
1906399140,12cyclictest3200-21ssh10:51:371
1906399140,10cyclictest9208-21chrt12:06:211
1906399140,10cyclictest9208-21chrt12:06:201
1906399140,10cyclictest9005-21df_inode10:55:131
1906399140,10cyclictest716-21snmpd10:35:301
1906399140,10cyclictest716-21snmpd07:32:231
1906399140,10cyclictest6990-21/usr/sbin/munin11:30:191
1906399140,10cyclictest5074-21ssh11:10:231
1906399140,10cyclictest3348-21rm09:40:201
1906399140,10cyclictest3273-21cat11:45:241
1906399140,10cyclictest32567-21/usr/sbin/munin08:45:171
1906399140,10cyclictest32550-21runrttasks10:32:031
1906399140,10cyclictest30954-21sed12:00:271
1906399140,10cyclictest29641-21runrttasks08:37:221
1906399140,10cyclictest29615-21rm11:06:051
1906399140,10cyclictest29595-21/usr/sbin/munin09:55:161
1906399140,10cyclictest2875-21ssh12:20:301
1906399140,10cyclictest2582-21sh12:39:071
1906399140,10cyclictest25404-21/usr/sbin/munin09:35:101
1906399140,10cyclictest24926-21rm11:40:041
1906399140,10cyclictest23788-21sh12:32:311
1906399140,10cyclictest23636-21ssh11:56:471
1906399140,10cyclictest22444-21taskset08:20:321
1906399140,10cyclictest21271-21ssh10:08:151
1906399140,10cyclictest18403-21atemtest08:15:111
1906399140,10cyclictest17516-21ssh12:10:521
1906399140,10cyclictest16802-21ssh09:48:011
1906399140,10cyclictest15955-21ssh11:35:071
1906399140,10cyclictest13439-21ntp_kernel_err09:10:171
691039130,0EcMasterDemoSyn0-21swapper/510:35:265
2930429130,10tAtEmLog_04938-21taskset11:10:235
2853799136,0tDemoTimingTask0-21swapper/509:54:555
1907599135,6cyclictest17088-21ntpq08:10:194
1907599131,9cyclictest648-21dbus-daemon08:55:204
1907599131,9cyclictest32032-21runrttasks08:42:364
1907599131,9cyclictest21413-21diskmemload11:20:114
1907599131,9cyclictest10276-21sh09:26:104
1907599130,9cyclictest780-21runrttasks09:35:024
1907599130,9cyclictest7783-21ssh10:00:214
1907599130,9cyclictest7783-21ssh10:00:214
1907599130,9cyclictest6611-21/usr/sbin/munin07:50:194
1907599130,9cyclictest4836-21/usr/sbin/munin10:35:144
1907599130,9cyclictest3606-21latency_hist07:45:004
1907599130,9cyclictest31404-21/usr/sbin/munin07:35:134
1907599130,9cyclictest30553-21sh12:00:244
1907599130,9cyclictest29749-21runrttasks08:38:474
1907599130,9cyclictest2510-21/usr/sbin/munin08:50:134
1907599130,9cyclictest24905-21grep07:20:144
1907599130,9cyclictest24223-21/usr/sbin/munin12:15:184
1907599130,9cyclictest23993-21needreboot10:45:174
1907599130,9cyclictest22182-21cpuspeed_turbos07:15:124
1907599130,9cyclictest20778-21/usr/sbin/munin08:20:194
1907599130,9cyclictest18446-21sh11:35:444
1907599130,9cyclictest14864-21sh12:10:094
1907599130,9cyclictest11446-21sort09:45:134
1907599130,10cyclictest9843-21ssh12:25:124
1907599130,10cyclictest8949-21chrt09:00:284
1907599130,10cyclictest4262-21df_inode07:45:124
1907599130,10cyclictest29621-21tune2fs07:30:144
1907599130,10cyclictest29544-21ssh11:42:104
1907599130,10cyclictest21421-21/usr/sbin/munin09:50:184
1907599130,10cyclictest20980-21rm11:55:194
1907599130,10cyclictest2056-21sh09:40:094
1907599130,10cyclictest19957-21cstates07:10:134
1907599130,10cyclictest1838-21cp10:50:394
1907599130,10cyclictest11171-21grep09:05:234
1907199135,6cyclictest7778-21fschecks_time09:00:153
1907199135,6cyclictest29285-21grep07:30:133
1907199135,6cyclictest21427-21ntpq09:50:183
1907199131,10cyclictest16-1pr/legacy07:48:053
1907199130,9cyclictest780-21runrttasks07:40:273
1907199130,9cyclictest31404-21/usr/sbin/munin07:35:123
1907199130,9cyclictest31212-21sh12:00:353
1907199130,9cyclictest30216-21/usr/sbin/munin08:40:123
1907199130,9cyclictest27844-21apt08:35:113
1907199130,9cyclictest27153-21sshd08:30:333
1907199130,9cyclictest26699-21taskset07:25:103
1907199130,9cyclictest2507-21taskset08:50:073
1907199130,9cyclictest23131-21/usr/sbin/munin08:25:133
1907199130,9cyclictest18393-21/usr/sbin/munin08:15:193
1907199130,9cyclictest18311-21sh12:11:273
1907199130,10cyclictest6873-21expr07:50:143
1907199130,10cyclictest5497-21tr08:55:153
1907199130,10cyclictest32639-21rm10:50:153
1907199130,10cyclictest26686-21/usr/sbin/munin11:05:223
1907199130,10cyclictest22637-21hddtemp_smartct07:15:153
1907199130,10cyclictest22037-21python308:20:203
1907199130,10cyclictest2057-21chrt08:48:433
1907199130,10cyclictest16402-21df_inode08:10:143
1906899130,9cyclictest7491-21cpuspeed09:00:132
1906899130,9cyclictest3903-21/usr/sbin/munin07:45:112
1906899130,9cyclictest31937-21fschecks_time07:35:142
1906899130,9cyclictest27954-21python307:25:212
1906899130,9cyclictest27272-21chrt08:32:092
1906899130,9cyclictest26471-21ssh11:05:022
1906899130,9cyclictest24344-21/usr/sbin/munin07:20:112
1906899130,9cyclictest23726-21gltestperf08:25:132
1906899130,9cyclictest18351-21latency_hist08:15:002
1906899130,10cyclictest9656-21cat07:55:162
1906899130,10cyclictest1797-21/usr/sbin/munin08:45:232
1906899130,10cyclictest12130-21latency08:00:152
1906399133,5cyclictest19686-21fschecks_count10:25:151
1906399131,9cyclictest9404-21latency_hist09:04:591
1906399130,9cyclictest9998-21ssh10:20:061
1906399130,9cyclictest9804-21sh12:25:091
1906399130,9cyclictest8609-21processes09:25:201
1906399130,9cyclictest4893-21aten2_r5power_c08:55:121
1906399130,9cyclictest25071-21if_enp6s007:20:151
1906399130,9cyclictest23131-21/usr/sbin/munin08:25:111
1906399130,9cyclictest22812-21ssh10:45:071
1906399130,9cyclictest19511-21apt-key07:10:001
1906399130,9cyclictest1547-21/usr/sbin/munin07:40:261
1906399130,9cyclictest11334-21/usr/sbin/munin08:00:171
1906399130,9cyclictest11217-21latency_hist08:00:001
1906399130,9cyclictest10583-21sh11:50:041
1906399130,10cyclictest32061-21taskset08:43:001
1906399130,10cyclictest2551-21aten2_r5power_e08:50:111
1906399130,10cyclictest23703-21runrttasks07:16:331
1905999130,9cyclictest29567-21runrttasks08:36:220
1878099130,11tDemoTimingTask18818-21chrt07:07:395
341039120,0EcMasterDemoSyn0-21swapper/507:43:015
2901139120,1EcMasterDemoSyn2902129tAtEmLog_009:19:225
2333599120,10tDemoTimingTask26442-21taskset11:58:465
208439120,10EcMasterDemoSyn41922sleep508:50:475
1933939120,0EcMasterDemoSyn0-21swapper/509:49:495
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional