You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-03 - 20:04
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Fri Apr 03, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9628391150,0EcMasterDemoSyn9636-21runintdemo5min12:12:231
2449739910,0EcMasterDemoSyn2450729tAtEmLog_011:26:445
2103239830,0EcMasterDemoSyn2104229tAtEmLog_009:55:285
1032539830,0EcMasterDemoSyn1033529tAtEmLog_011:36:535
715739820,0EcMasterDemoSyn716729tAtEmLog_008:14:035
634139820,0EcMasterDemoSyn635129tAtEmLog_010:41:065
2866639820,0EcMasterDemoSyn2867629tAtEmLog_009:25:025
2270839820,0EcMasterDemoSyn2271829tAtEmLog_007:38:335
1948539820,0EcMasterDemoSyn1949729tAtEmLog_011:41:575
545039810,0EcMasterDemoSyn546029tAtEmLog_009:30:075
2612139810,0EcMasterDemoSyn2613129tAtEmLog_008:54:375
1190339810,0EcMasterDemoSyn1191329tAtEmLog_008:24:125
715739220,0EcMasterDemoSyn0-21swapper/008:14:030
1136539210,1EcMasterDemoSyn11371-21ps09:50:240
822699196,9cyclictest5437-21sh10:58:420
822699196,9cyclictest5437-21sh10:58:420
822699180,9cyclictest7408-21sh10:24:340
2944799180,8tDemoTimingTask29788-21chrt11:11:455
2848999180,8tDemoTimingTask30568-21chrt09:00:575
2529429180,7tAtEmLog_032448-21chrt10:55:185
2529429180,7tAtEmLog_032448-21chrt10:55:185
1272339180,0EcMasterDemoSyn0-21swapper/507:18:155
953529170,10tAtEmLog_09623-21chrt08:19:555
8244991714,2cyclictest0-21swapper/409:50:004
823599175,9cyclictest648-21dbus-daemon10:34:142
823199175,9cyclictest716-21snmpd10:39:141
8231991714,2cyclictest0-21swapper/110:10:001
822699179,6cyclictest19025-21cut09:55:120
822699170,9cyclictest8109-21sh10:06:220
822699170,9cyclictest31450-21sh10:37:190
822699170,9cyclictest25543-21sh10:34:310
822699170,14cyclictest32429-21sh11:30:590
3247999170,10tDemoTimingTask32483-21chrt07:58:515
287492170,1sleep20-21swapper/211:29:462
2848999170,7tDemoTimingTask26201-21turbostat08:59:555
2820299170,10tDemoTimingTask28312-21chrt12:22:345
1533229170,10tAtEmLog_015343-21chrt11:21:405
1426999170,7tDemoTimingTask16482-21chrt08:32:405
1426999170,7tDemoTimingTask14310-21taskset08:29:275
8244991612,3cyclictest8316-21latency_hist12:30:014
824499160,12cyclictest16-1pr/legacy10:00:314
824099165,6cyclictest24357-21sort08:50:133
824099160,8cyclictest21482-21ssh10:14:233
824099160,10cyclictest29163-21sh11:11:213
824099160,10cyclictest22866-21turbostat.cron07:44:563
824099160,10cyclictest22866-21turbostat.cron07:44:553
823599164,9cyclictest31838-21expr09:05:152
823599160,9cyclictest9319-21sh11:18:482
823199168,7cyclictest8219-21cyclictest12:03:301
823199168,6cyclictest31386-21turbostat.cron10:20:001
823199164,9cyclictest27262-21find11:10:201
822699166,3cyclictest24356-21grep09:40:140
822699164,9cyclictest21680-21sh12:00:420
822699160,9cyclictest780-21runrttasks07:32:350
822699160,14cyclictest24990-21grep11:45:110
799929160,10tAtEmLog_05834-21sleep07:09:555
48099160,9tDemoTimingTask504-21taskset12:07:195
1037399160,9tDemoTimingTask10530-21taskset07:14:565
824499158,5cyclictest28828-21sed07:50:134
824499151,10cyclictest13221-21/usr/sbin/munin07:20:164
824099155,8cyclictest6689-21/usr/sbin/munin11:35:133
824099150,9cyclictest2467-21/usr/sbin/munin09:45:233
824099150,12cyclictest10844-21/usr/sbin/munin07:15:123
824099150,11cyclictest32388-21wget12:25:133
824099150,11cyclictest24103-21sh12:38:283
824099150,10cyclictest16953-21chrt11:58:473
823599150,10cyclictest2643-21sh11:32:492
823199154,8cyclictest728-21lldpd09:31:411
823199153,8cyclictest648-21dbus-daemon07:38:031
823199152,10cyclictest16-1pr/legacy08:03:531
823199151,11cyclictest16-1pr/legacy08:14:021
823199151,10cyclictest29810-21ssh12:05:231
823199151,10cyclictest18084-21ssh11:23:341
823199150,9cyclictest28889-21apt-get09:25:101
823199150,11cyclictest16-1pr/legacy07:18:151
822699156,7cyclictest10662-21df11:55:130
822699154,8cyclictest174-1kworker/0:1H+kblockd11:42:180
822699150,9cyclictest780-21runrttasks09:47:060
822699150,9cyclictest1635-21ssh12:08:050
822699150,6cyclictest868-21diskmemload12:26:190
2960029150,8tAtEmLog_029625-21taskset10:36:035
2141929150,13tAtEmLog_023531-21taskset08:46:305
1915299150,9tDemoTimingTask19245-21sleep09:24:555
1119699150,9tDemoTimingTask16215-21chrt11:04:565
824499146,6cyclictest8564-21/usr/sbin/munin11:00:154
824499146,6cyclictest16828-21python307:25:204
824499146,6cyclictest11482-21sed07:15:144
824499143,8cyclictest8741-21cpu10:25:124
824499141,9cyclictest9468-21sh09:31:454
824499141,9cyclictest24371-21sh12:38:394
824499141,9cyclictest2430-21runrttasks08:03:544
824499141,9cyclictest10551-21/usr/sbin/munin09:15:194
824499141,8cyclictest30561-21aten2_r5power_c07:55:114
8244991411,2cyclictest711-21gdbus07:35:014
824499141,10cyclictest4779-21runrttasks08:08:524
824499141,10cyclictest1207-21sh10:38:514
824499140,9cyclictest32675-21sh11:31:104
824499140,9cyclictest28563-21sh11:29:374
824499140,9cyclictest20353-21ps11:06:274
824499140,9cyclictest19444-21/usr/sbin/munin08:40:244
824499140,10cyclictest8498-21ssh10:42:364
824499140,10cyclictest5467-21sh10:05:174
824499140,10cyclictest30928-21latency_hist09:05:004
824499140,10cyclictest27809-21sh10:17:284
824499140,10cyclictest23581-21chrt08:47:104
824499140,10cyclictest23523-21ssh09:40:014
824499140,10cyclictest22114-21/usr/sbin/munin10:50:114
824499140,10cyclictest21909-21ssh10:14:424
824499140,10cyclictest21062-21fschecks_count07:35:144
824499140,10cyclictest20654-21ssh12:00:194
824499140,10cyclictest17805-21ssh12:16:494
824499140,10cyclictest15196-21sh11:40:074
824499140,10cyclictest14640-21/usr/sbin/munin09:35:124
824499140,10cyclictest12510-21ssh10:45:024
824499140,10cyclictest11570-21ssh11:20:114
824499140,10cyclictest10576-21ssh11:19:424
824099146,6cyclictest716-21snmpd07:35:143
824099143,8cyclictest31344-21tr09:05:123
824099141,9cyclictest3218-21ssh10:40:033
824099141,9cyclictest29905-21cpuspeed_turbos11:30:123
824099141,9cyclictest28874-21/usr/sbin/munin09:00:133
8240991412,2cyclictest31640-21kworker/3:1+events10:15:443
824099140,9cyclictest21652-21ssh10:31:473
824099140,12cyclictest17528-21ssh10:47:233
824099140,11cyclictest11014-21sh10:25:443
824099140,10cyclictest8898-21sh11:18:313
824099140,10cyclictest886-21/usr/sbin/munin08:00:133
824099140,10cyclictest8603-21sh12:11:403
824099140,10cyclictest8211-21tail08:15:143
824099140,10cyclictest780-21runrttasks07:11:033
824099140,10cyclictest6001-21sh09:12:153
824099140,10cyclictest5918-21needreboot10:05:203
824099140,10cyclictest5473-21sh11:52:023
824099140,10cyclictest5348-21sh09:30:033
824099140,10cyclictest31751-21sh10:20:023
824099140,10cyclictest30550-21/usr/sbin/munin07:55:163
824099140,10cyclictest30383-21rm12:05:303
824099140,10cyclictest2867-21/usr/sbin/munin08:05:133
824099140,10cyclictest27833-21ssh11:46:183
824099140,10cyclictest25845-21/usr/sbin/munin07:45:243
824099140,10cyclictest25056-21ssh09:58:173
824099140,10cyclictest23879-21ssh09:21:543
824099140,10cyclictest23747-21apt-get09:40:113
824099140,10cyclictest23295-21/usr/sbin/munin12:20:123
824099140,10cyclictest22315-21xargs11:25:253
824099140,10cyclictest22241-21ssh10:50:133
824099140,10cyclictest22078-21tr08:45:113
824099140,10cyclictest21784-21runrttasks11:07:273
824099140,10cyclictest21455-21ssh12:00:333
824099140,10cyclictest20248-21sh09:37:563
824099140,10cyclictest19536-21runrttasks07:30:193
824099140,10cyclictest1866-21sh10:56:123
824099140,10cyclictest1866-21sh10:56:123
824099140,10cyclictest1845-21taskset09:27:483
824099140,10cyclictest18066-21sh09:19:143
824099140,10cyclictest17629-21grep08:35:143
824099140,10cyclictest16883-21rm12:16:093
824099140,10cyclictest15571-21/usr/sbin/munin07:25:123
824099140,10cyclictest15527-21latency08:30:163
824099140,10cyclictest15135-21ssh11:40:033
824099140,10cyclictest14677-21sh09:52:253
824099140,10cyclictest14225-21sh11:20:543
824099140,10cyclictest13255-21wget07:20:113
824099140,10cyclictest13005-21sh11:02:393
824099140,10cyclictest11512-21sh12:30:563
823599141,9cyclictest9507-21sh10:07:212
823599141,9cyclictest716-21snmpd07:37:432
823599141,9cyclictest30640-21cut07:55:112
823599141,9cyclictest2756-21ssh09:45:272
823599141,9cyclictest12710-21ssh10:45:092
823599141,10cyclictest16-1pr/legacy08:29:152
8235991410,3cyclictest27921-21head10:35:182
823599140,12cyclictest21589-21grep09:20:232
823599140,12cyclictest10794-21ssh12:30:252
823599140,10cyclictest9960-21/usr/sbin/munin08:20:182
823599140,10cyclictest7862-21/usr/sbin/munin11:00:202
823599140,10cyclictest780-21runrttasks09:41:532
823599140,10cyclictest4922-21latency_hist08:10:002
823599140,10cyclictest4082-21rm12:27:022
823599140,10cyclictest3790-21rm10:57:312
823599140,10cyclictest3790-21rm10:57:312
823599140,10cyclictest3618-21ssh10:21:542
823599140,10cyclictest3365-21/usr/sbin/munin10:40:112
823599140,10cyclictest29176-21ssh11:47:132
823599140,10cyclictest28886-21/usr/sbin/munin09:25:212
823599140,10cyclictest28696-21perl07:50:132
823599140,10cyclictest28305-21/usr/sbin/munin12:05:122
823599140,10cyclictest26723-21ssh12:21:292
823599140,10cyclictest2614-21grep09:10:182
823599140,10cyclictest26017-21ssh12:03:462
823599140,10cyclictest25393-21ssh10:15:462
823599140,10cyclictest22599-21fschecks_count10:50:142
823599140,10cyclictest2108-21if_err_enp6s011:50:162
823599140,10cyclictest20802-21rm11:42:532
823599140,10cyclictest18585-21sh11:59:532
823599140,10cyclictest18180-21rm10:12:032
823599140,10cyclictest15358-21ssh11:21:412
823599140,10cyclictest14640-21/usr/sbin/munin09:35:232
823599140,10cyclictest14179-21ssh09:52:042
823599140,10cyclictest12015-21sh09:15:202
823199144,7cyclictest22450-21wc11:25:261
823199141,9cyclictest28048-21/usr/sbin/munin10:00:181
823199141,9cyclictest2075-21runrttasks12:25:361
823199141,9cyclictest18424-21sh10:12:131
823199141,9cyclictest10253-21/usr/sbin/munin11:55:151
8231991410,3cyclictest17632-21sh07:30:011
823199140,11cyclictest811-21runintdemo5min07:53:461
823199140,10cyclictest8491-21/usr/sbin/munin07:10:131
823199140,10cyclictest780-21runrttasks11:52:121
823199140,10cyclictest716-21snmpd07:34:061
823199140,10cyclictest4672-21runrttasks08:07:261
823199140,10cyclictest3624-21ssh10:21:531
823199140,10cyclictest30936-21rm09:44:041
823199140,10cyclictest29652-21/usr/sbin/munin11:30:191
823199140,10cyclictest29348-21sh12:23:211
823199140,10cyclictest27171-21smartctl08:55:131
823199140,10cyclictest27033-21ssh11:45:441
823199140,10cyclictest24568-21ssh09:22:231
823199140,10cyclictest24091-21ssh10:50:251
823199140,10cyclictest22664-21ssh11:44:111
823199140,10cyclictest20963-21ssh09:55:261
823199140,10cyclictest20836-21rm10:31:121
823199140,10cyclictest19498-21rm10:48:441
823199140,10cyclictest19299-21sh09:37:151
823199140,10cyclictest17788-21latency11:05:161
823199140,10cyclictest17755-21/usr/sbin/munin12:35:181
823199140,10cyclictest16229-21diskmemload09:18:001
823199140,10cyclictest15277-21latency_hist07:25:011
823199140,10cyclictest14250-21ssh11:39:391
823199140,10cyclictest1404-21/usr/sbin/munin09:10:111
823199140,10cyclictest13893-21/usr/sbin/munin12:15:191
823199140,10cyclictest10994-21awk08:20:181
823199140,10cyclictest10653-21ssh11:01:011
823199140,10cyclictest10164-21cpuspeed_turbos09:50:141
822699146,6cyclictest10023-21ssh12:30:170
822699145,7cyclictest9430-21cat10:25:160
822699145,7cyclictest9177-21/usr/sbin/munin07:10:160
822699145,7cyclictest31540-21ssh11:13:000
822699145,7cyclictest20156-21expr09:20:120
822699143,8cyclictest755-21postgres08:22:280
8226991411,2cyclictest11035-21awk11:20:000
8226991410,3cyclictest29201-21cpuspeed_turbos09:25:120
8226991410,3cyclictest15810-21tail09:35:180
822699140,9cyclictest25912-21aten2_r5power_p07:45:110
822699140,9cyclictest174-1kworker/0:1H+kblockd10:45:330
822699140,7cyclictest8151-21/usr/sbin/munin11:35:230
822699140,7cyclictest30250-21expr10:00:330
822699140,7cyclictest28866-21kworker/u24:2+flush-9:009:34:190
822699140,7cyclictest22792-21ssh11:25:330
822699140,7cyclictest14462-21cat08:29:590
822699140,7cyclictest12131-21ssh11:02:010
822699140,12cyclictest5589-21ssh10:40:350
822699140,12cyclictest24416-21grep12:20:190
822699140,12cyclictest22236-21wget10:50:110
822699140,12cyclictest20325-21chrt11:06:270
822699140,12cyclictest1906-21fschecks_count09:10:140
822699140,10cyclictest8770-21ssh12:11:470
822699140,10cyclictest4482-21sh11:51:200
822699140,10cyclictest28195-21chrt08:55:570
822699140,10cyclictest18769-21chrt08:35:590
822699140,10cyclictest14665-21sh12:15:150
822699140,10cyclictest12841-21ssh11:20:190
822699140,10cyclictest11504-21ls09:15:170
700899140,12tDemoTimingTask10383-21chrt10:07:585
824499135,6cyclictest8852-21diskstats07:10:134
824499135,6cyclictest17017-21apt08:35:104
824499132,8cyclictest32173-21cpuspeed10:20:124
824499130,9cyclictest9690-21sh09:50:064
824499130,9cyclictest9408-21sshd08:17:434
824499130,9cyclictest780-21runrttasks08:25:064
824499130,9cyclictest780-21runrttasks08:10:094
824499130,9cyclictest4749-21ssh12:10:054
824499130,9cyclictest32400-21ntp_kernel_pll_10:55:184
824499130,9cyclictest32400-21ntp_kernel_pll_10:55:184
824499130,9cyclictest31896-21hddtemp_smartct09:05:154
824499130,9cyclictest29165-21irqstats12:05:164
824499130,9cyclictest28886-21/usr/sbin/munin09:25:154
824499130,9cyclictest26679-21sh11:45:284
824499130,9cyclictest26568-21basename08:55:114
824499130,9cyclictest23269-21/usr/sbin/munin12:20:184
824499130,9cyclictest23226-21/usr/sbin/munin07:40:134
824499130,9cyclictest23226-21/usr/sbin/munin07:40:134
824499130,9cyclictest18940-21ssh09:55:114
824499130,9cyclictest17624-21apt-get10:30:104
824499130,9cyclictest15374-21if_enp6s008:30:164
824499130,9cyclictest1197-21sh09:10:024
824499130,9cyclictest11311-21/usr/sbin/munin08:20:234
824499130,9cyclictest1020-21runrttasks11:50:004
824499130,10cyclictest9389-21fschecks_time12:30:134
824499130,10cyclictest7273-21memory11:35:174
824499130,10cyclictest26305-21fschecks_count07:45:144
824499130,10cyclictest26168-21chrt08:54:434
824499130,10cyclictest25906-21/usr/sbin/munin11:10:174
824499130,10cyclictest19636-21ssh09:20:044
824499130,10cyclictest10150-21sh11:55:064
824099135,6cyclictest27492-21head08:55:173
824099130,9cyclictest9960-21/usr/sbin/munin08:20:183
824099130,9cyclictest5683-21tune2fs08:10:153
824099130,9cyclictest28720-21users10:35:253
824099130,9cyclictest28367-21cpuspeed07:50:113
824099130,9cyclictest28048-21/usr/sbin/munin10:00:173
824099130,9cyclictest19977-21fschecks_time08:40:143
824099130,10cyclictest14069-21chrt08:26:493
823599135,6cyclictest326-21systemd-journal07:12:412
823599135,6cyclictest21840-21cut08:45:102
823599135,6cyclictest19505-21fschecks_count09:55:142
823599135,6cyclictest14775-21aten2_r5power_v08:30:122
823599135,6cyclictest10847-21apt-get07:15:102
823599132,8cyclictest16913-21cut11:05:112
823599131,9cyclictest8638-21runrttasks08:15:162
823599130,9cyclictest780-21runrttasks07:21:242
823599130,9cyclictest6572-21latency09:30:182
823599130,9cyclictest5222-21/usr/sbin/munin08:10:172
823599130,9cyclictest28874-21/usr/sbin/munin09:00:152
823599130,9cyclictest27350-21sensors11:10:202
823599130,9cyclictest26971-21processes07:45:192
823599130,9cyclictest24148-21/usr/sbin/munin08:50:172
823599130,9cyclictest23271-21hostname07:40:132
823599130,9cyclictest23271-21hostname07:40:132
823599130,9cyclictest21263-21runrttasks08:42:382
823599130,9cyclictest20270-21taskset07:34:152
823599130,9cyclictest17030-21aten2_r5power_c08:35:112
823599130,9cyclictest13665-21sh12:15:012
823599130,9cyclictest10091-21sh10:25:222
823599130,7cyclictest6264-21ssh11:35:102
823599130,10cyclictest6115-21ntp_offset12:10:182
823599130,10cyclictest28056-21apt-get10:00:102
823599130,10cyclictest2135-21grep08:00:232
823599130,10cyclictest20223-21sh12:35:442
823599130,10cyclictest15594-21/usr/sbin/munin07:25:102
823199138,4cyclictest31551-21head07:55:171
823199135,6cyclictest22174-21fschecks_count08:45:121
823199130,9cyclictest8516-21ssh10:25:081
823199130,9cyclictest780-21runrttasks08:17:371
823199130,9cyclictest780-21runrttasks07:47:001
823199130,9cyclictest780-21runrttasks07:41:501
823199130,9cyclictest780-21runrttasks07:41:501
823199130,9cyclictest3329-21sh10:40:071
823199130,9cyclictest32763-21apt-key09:45:001
823199130,9cyclictest32176-21load10:55:161
823199130,9cyclictest32176-21load10:55:161
823199130,9cyclictest17134-21cut08:35:121
823199130,9cyclictest14664-21/usr/sbin/munin08:30:181
823199130,9cyclictest12311-21/usr/sbin/munin08:25:131
823199130,10cyclictest4550-21runrttasks11:15:291
823199130,10cyclictest31675-21grep09:05:141
823199130,10cyclictest24148-21/usr/sbin/munin08:50:121
823199130,10cyclictest20111-21hddtemp_smartct08:40:141
823199130,10cyclictest12303-21ssh12:31:301
822699135,7cyclictest0-21swapper/010:15:260
822699130,9cyclictest9400-21runrttasks08:17:360
822699130,9cyclictest8398-21latency_hist07:10:010
822699130,9cyclictest780-21runrttasks09:00:250
822699130,9cyclictest780-21runrttasks08:40:200
822699130,9cyclictest780-21runrttasks08:07:180
822699130,9cyclictest22156-21diskstats08:45:120
822699130,9cyclictest21387-21awk07:35:150
822699130,9cyclictest17120-21unixbench_multi07:25:230
822699130,9cyclictest17041-21sh10:11:170
822699130,7cyclictest24741-21awk07:40:250
822699130,7cyclictest24741-21awk07:40:250
822699130,7cyclictest19026-21ntp_kernel_pll_12:35:170
822699130,7cyclictest174-1kworker/0:1H+kblockd09:05:220
822699130,7cyclictest174-1kworker/0:1H+kblockd08:51:480
822699130,7cyclictest13721-21fschecks_time07:20:120
822699130,10cyclictest756-21postgres08:00:270
822699130,10cyclictest30929-21fschecks_count07:55:130
822699130,10cyclictest29012-21sed07:50:160
822699130,10cyclictest15368-21basename08:30:160
822699130,10cyclictest11955-21proc_pri07:15:180
700899130,11tDemoTimingTask15305-21chrt10:10:235
1463199131,10tDemoTimingTask21146-21taskset09:38:345
824499120,8cyclictest8454-21latency_hist07:10:014
823599120,9cyclictest8253-21latency_hist07:10:012
823599120,9cyclictest26953-21cut08:55:132
823199124,6cyclictest29328-21fschecks_count09:00:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional