You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-27 - 07:01
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Mon Apr 27, 2026 00:44:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
290139920,0EcMasterDemoSyn291129tAtEmLog_019:37:035
2690839900,0EcMasterDemoSyn2691829tAtEmLog_020:27:465
1582239830,0EcMasterDemoSyn1583229tAtEmLog_023:50:355
636739820,0EcMasterDemoSyn637729tAtEmLog_020:53:065
528339820,0EcMasterDemoSyn529329tAtEmLog_019:42:075
48939820,0EcMasterDemoSyn49929tAtEmLog_019:31:585
2818239820,0EcMasterDemoSyn2819229tAtEmLog_019:21:505
2481939820,0EcMasterDemoSyn2482929tAtEmLog_022:44:405
2217439820,0EcMasterDemoSyn2218429tAtEmLog_020:17:365
2107039820,0EcMasterDemoSyn2108029tAtEmLog_019:06:385
1270939820,0EcMasterDemoSyn1272029tAtEmLog_019:57:205
3059339810,0EcMasterDemoSyn3060329tAtEmLog_019:26:545
2932039810,0EcMasterDemoSyn2933029tAtEmLog_020:32:495
2875439810,0EcMasterDemoSyn2876429tAtEmLog_000:15:565
2486339810,0EcMasterDemoSyn2487329tAtEmLog_022:09:105
160539810,0EcMasterDemoSyn161529tAtEmLog_022:49:445
1509139760,1EcMasterDemoSyn15099-21runintdemo5min20:02:241
270962560,1sleep50-21swapper/521:16:335
205572280,0sleep10-21swapper/122:41:391
94862270,2sleep132-21ksoftirqd/121:00:151
2875439220,1EcMasterDemoSyn28762-21grep00:15:572
2141699198,6cyclictest16746-21grep20:05:200
2141699191,10cyclictest1380-21sh00:19:280
402099180,8tDemoTimingTask4138-21chrt20:49:165
324182180,0sleep00-21swapper/022:30:190
2141699185,9cyclictest6408-21sh22:51:440
2141699180,10cyclictest21255-21ssh21:13:580
673029170,7tAtEmLog_011719-21taskset21:25:405
657729170,7tAtEmLog_08522-21chrt22:00:105
2143299170,9cyclictest20985-21sh22:06:274
2142099179,6cyclictest22702-21sort22:25:141
2141699170,9cyclictest22737-21sh00:13:010
2141699170,9cyclictest1803-21sh22:14:070
2141699170,14cyclictest22697-21sh23:00:260
2141699170,14cyclictest19008-21ssh22:40:350
2141699170,10cyclictest780-21runrttasks20:26:290
873599160,6tDemoTimingTask10017-21taskset21:00:185
2143299164,8cyclictest755-21postgres19:59:254
2143299160,9cyclictest18336-21ssh21:30:054
2142999165,8cyclictest8239-21fschecks_count22:35:153
2142999165,8cyclictest716-21snmpd23:04:363
2142999164,8cyclictest20293-21latency_hist23:00:003
2142999160,9cyclictest2134-21sh00:00:583
2142999160,12cyclictest28000-21fw_packets20:30:153
2142999160,10cyclictest5049-21ssh23:26:483
21424991613,2cyclictest523-21cron23:24:592
21424991613,2cyclictest0-21swapper/222:00:262
21424991612,3cyclictest695-21rs:main2
2141699168,6cyclictest13475-21wget21:45:120
2141699165,10cyclictest25714-21netstat23:20:210
2141699164,9cyclictest19287-21sh22:23:280
2141699160,9cyclictest15845-21sh23:50:360
2141699160,14cyclictest24982-21sensors21:15:210
2141699160,13cyclictest3377-21runrttasks00:01:520
175439160,0EcMasterDemoSyn0-21swapper/500:00:435
1347499160,9tDemoTimingTask13478-21chrt21:08:205
2218599150,13tDemoTimingTask23396-21chrt20:20:175
2143299150,8cyclictest19853-21ssh22:41:094
2142999152,9cyclictest23722-21needreboot23:55:193
2142999152,9cyclictest10153-21sh22:18:383
21429991511,3cyclictest32161-21cpuspeed_turbos21:55:143
2142999150,9cyclictest8976-21ssh21:42:193
21424991511,3cyclictest26264-21sh23:03:002
2142499151,11cyclictest21191-21ssh22:06:362
2142499151,10cyclictest30912-21ssh23:59:512
2142499151,10cyclictest24601-21runrttasks23:38:012
2142499150,9cyclictest26838-21runrttasks20:26:562
2142499150,12cyclictest10934-21sh00:24:522
2142499150,11cyclictest32505-21ssh22:48:412
2142499150,11cyclictest19328-21ssh23:53:042
2142499150,11cyclictest16152-21ssh22:57:132
2142499150,11cyclictest15159-21ssh00:26:152
2142099151,10cyclictest24820-21ssh00:31:451
2142099150,9cyclictest26263-21runrttasks23:02:581
2141699157,6cyclictest32733-21cut20:40:140
2141699155,8cyclictest13712-21timerandwakeup00:25:260
2141699152,9cyclictest5501-21sh23:09:460
2141699152,10cyclictest18504-21cat23:35:000
2141699151,7cyclictest17476-21ssh21:29:410
2141699151,12cyclictest17921-21sh22:58:300
2141699151,10cyclictest25062-21sh22:26:080
2141699150,8cyclictest3633-21/usr/sbin/munin22:15:110
2141699150,11cyclictest7540-21sh00:22:260
2141699150,11cyclictest3144-21rm23:44:210
2141699150,11cyclictest24748-21sh23:55:320
2141699150,11cyclictest21978-21ssh23:36:090
2141699150,10cyclictest3263-21sh23:25:310
196629150,9tAtEmLog_027063-21sleep21:39:555
1510129150,9tAtEmLog_015316-21taskset20:04:565
1115929150,9tAtEmLog_011174-21taskset21:43:495
2143299144,8cyclictest32696-21/usr/sbin/munin21:55:174
2143299143,6cyclictest7760-21wc00:05:004
2143299142,7cyclictest286-21jbd2/md0-821:45:214
2143299141,9cyclictest24035-21/usr/sbin/munin19:15:244
2143299141,9cyclictest23987-21latency_hist19:15:004
2143299141,9cyclictest23385-21runrttasks23:00:564
21432991412,2cyclictest4913-21kworker/4:1+events23:35:214
2143299140,10cyclictest780-21runrttasks19:30:034
2143299140,10cyclictest7781-21/usr/sbin/munin22:35:214
2143299140,10cyclictest7129-21sh21:41:004
2143299140,10cyclictest3325-21wc20:45:194
2143299140,10cyclictest29516-21sh21:35:254
2143299140,10cyclictest2829-21runrttasks19:36:124
2143299140,10cyclictest25717-21ssh21:15:364
2143299140,10cyclictest20058-21ssh22:24:024
2143299140,10cyclictest19982-21ssh23:53:314
2143299140,10cyclictest17983-21/usr/sbin/munin20:10:204
2143299140,10cyclictest16558-21sh22:57:304
2143299140,10cyclictest16376-21ssh00:27:084
2143299140,10cyclictest13277-21/usr/sbin/munin20:00:144
2143299140,10cyclictest11901-21sh23:49:114
2142999146,6cyclictest26994-21/usr/sbin/munin00:15:183
2142999146,6cyclictest16099-21/usr/sbin/munin21:10:233
2142999143,8cyclictest8348-21wget00:05:123
2142999143,8cyclictest8048-21readlink20:55:223
2142999143,8cyclictest22411-21if_err_enp6s019:10:153
2142999143,8cyclictest19804-21proc_pri21:30:203
2142999142,9cyclictest780-21runrttasks19:36:373
2142999141,9cyclictest3943-21ssh00:20:193
2142999141,9cyclictest336-21aten2_r5power_e21:20:133
2142999141,9cyclictest30511-21runrttasks19:25:573
2142999141,9cyclictest30018-21runrttasks22:11:103
2142999141,9cyclictest26412-21/usr/sbin/munin19:20:143
2142999141,9cyclictest22815-21/usr/sbin/munin21:50:203
2142999141,9cyclictest20240-21sh22:05:563
2142999141,9cyclictest18776-21diskmemload21:47:493
2142999141,9cyclictest13390-21ssh23:31:223
2142999141,10cyclictest5051-21sh00:39:093
2142999141,10cyclictest30556-21sh23:23:163
2142999141,10cyclictest19930-21cat23:35:163
2142999141,10cyclictest14204-21ssh00:25:363
2142999140,9cyclictest26028-21needreboot20:25:193
2142999140,8cyclictest32636-21ssh22:30:213
2142999140,11cyclictest31822-21chrt20:39:193
2142999140,11cyclictest16366-21sh22:04:323
2142999140,11cyclictest1039-21/usr/sbin/munin20:40:203
2142999140,10cyclictest8497-21/usr/sbin/munin19:50:203
2142999140,10cyclictest7643-21cat19:45:223
2142999140,10cyclictest32079-21ssh23:41:543
2142999140,10cyclictest28075-21sh22:28:163
2142999140,10cyclictest27407-21sh22:45:233
2142999140,10cyclictest23536-21/usr/sbin/munin21:15:143
2142999140,10cyclictest20588-21ps22:24:243
2142999140,10cyclictest20336-21/usr/sbin/munin20:15:163
2142999140,10cyclictest17983-21basename00:10:153
2142999140,10cyclictest16241-21sh23:15:173
2142999140,10cyclictest1449-21sh23:06:543
2142999140,10cyclictest12988-21sh21:26:333
2142999140,10cyclictest11942-21diskstats21:05:133
2142499142,9cyclictest10892-21ssh21:25:222
2142499142,8cyclictest12931-21switchtime21:05:232
2142499141,9cyclictest8745-21latency22:35:172
2142499140,12cyclictest19357-21sh00:10:392
2142499140,11cyclictest31142-40mandb00:00:022
2142499140,10cyclictest9230-21/usr/sbin/munin21:00:202
2142499140,10cyclictest8748-21sh21:42:092
2142499140,10cyclictest780-21runrttasks20:24:172
2142499140,10cyclictest780-21runrttasks20:14:562
2142499140,10cyclictest716-21snmpd19:29:442
2142499140,10cyclictest6844-21taskset20:55:022
2142499140,10cyclictest6433-21/usr/sbin/munin23:10:152
2142499140,10cyclictest6018-21ssh22:51:272
2142499140,10cyclictest5708-21ssh22:15:292
2142499140,10cyclictest4598-21ssh23:09:082
2142499140,10cyclictest4581-21/usr/sbin/munin23:45:182
2142499140,10cyclictest4504-21/usr/sbin/munin20:50:252
2142499140,10cyclictest32536-21mailstats22:30:202
2142499140,10cyclictest32194-21cpuspeed_turbos21:55:132
2142499140,10cyclictest30073-21ssh23:40:292
2142499140,10cyclictest30009-21sh00:35:022
2142499140,10cyclictest29833-21/usr/sbin/munin20:35:152
2142499140,10cyclictest29711-21ssh22:10:572
2142499140,10cyclictest29241-21chrt20:31:522
2142499140,10cyclictest28035-21ssh00:34:042
2142499140,10cyclictest27096-21chrt21:52:052
2142499140,10cyclictest2693-21ssh21:20:432
2142499140,10cyclictest22559-21missed_timers19:10:162
2142499140,10cyclictest22038-21ssh22:25:092
2142499140,10cyclictest2157-21ssh21:38:522
2142499140,10cyclictest2048-21/usr/sbin/munin23:25:192
2142499140,10cyclictest19143-21ssh23:16:402
2142499140,10cyclictest18671-21aten2_r5power_v21:30:132
2142499140,10cyclictest17413-21ssh22:22:092
2142499140,10cyclictest17252-21chrt21:11:112
2142499140,10cyclictest16777-21ssh22:40:082
2142499140,10cyclictest16702-21sh21:46:222
2142499140,10cyclictest15775-21sh00:09:232
2142499140,10cyclictest15637-21apt-get20:05:112
2142499140,10cyclictest13575-21sh23:31:302
2142499140,10cyclictest11173-21tr19:55:142
2142499140,10cyclictest1115-21/usr/sbin/munin19:35:172
2142099143,8cyclictest27272-21systemctl22:45:211
2142099143,8cyclictest25806-21grep19:16:461
2142099141,9cyclictest22722-21/usr/sbin/munin20:20:271
2142099141,9cyclictest21408-21runrttasks00:12:051
2142099141,9cyclictest20321-21runrttasks20:15:011
2142099141,9cyclictest13575-21runrttasks21:09:181
21420991411,2cyclictest31882-21cron20:40:001
2142099141,10cyclictest3129-21ssh21:21:011
2142099140,9cyclictest32123-21cron21:20:001
2142099140,7cyclictest25225-21ssh23:55:511
2142099140,7cyclictest19264-21ssh23:53:011
2142099140,12cyclictest595-21sh21:37:501
2142099140,10cyclictest887-21runrttasks23:25:021
2142099140,10cyclictest811-21runintdemo5min20:42:581
2142099140,10cyclictest780-21runrttasks22:13:041
2142099140,10cyclictest780-21runrttasks19:10:581
2142099140,10cyclictest780-21runrttasks00:19:211
2142099140,10cyclictest7589-21ssh22:35:021
2142099140,10cyclictest7535-21sh23:46:051
2142099140,10cyclictest6860-21/usr/sbin/munin20:55:221
2142099140,10cyclictest6617-21ssh00:04:161
2142099140,10cyclictest32514-21sh23:42:111
2142099140,10cyclictest32254-21ssh23:05:461
2142099140,10cyclictest31629-21rm21:55:001
2142099140,10cyclictest31579-21sh00:35:201
2142099140,10cyclictest26849-21ssh23:20:421
2142099140,10cyclictest26641-21ssh23:39:281
2142099140,10cyclictest2498-21sh00:20:031
2142099140,10cyclictest22815-21/usr/sbin/munin21:50:151
2142099140,10cyclictest22765-21cat21:15:001
2142099140,10cyclictest22053-21runrttasks21:31:321
2142099140,10cyclictest18705-21cut22:05:191
2142099140,10cyclictest18646-21rm22:59:001
2142099140,10cyclictest18195-21grep20:10:131
2142099140,10cyclictest17618-21ssh22:22:181
2142099140,10cyclictest13265-21ssh23:13:531
2142099140,10cyclictest13172-21ssh00:25:191
2142099140,10cyclictest1-21systemd19:36:311
2142099140,10cyclictest10847-21/usr/sbin/munin19:55:201
2142099140,10cyclictest10775-21ssh22:19:041
2142099140,10cyclictest10440-21sh22:54:351
2141699145,7cyclictest31819-21ssh21:55:080
2141699143,8cyclictest26988-21cat22:45:180
2141699141,9cyclictest780-21runrttasks23:11:050
2141699141,9cyclictest25970-21taskset19:18:300
2141699141,11cyclictest21369-21latency_hist19:10:000
2141699141,10cyclictest24771-21latency_hist20:25:010
2141699141,10cyclictest19798-21runintdemo5min20:12:310
2141699141,10cyclictest13516-21runrttasks21:08:300
2141699141,10cyclictest10472-21taskset19:54:070
2141699140,7cyclictest2370-21sh21:20:290
2141699140,7cyclictest15546-21basename23:15:120
2141699140,12cyclictest17982-21df_inode22:05:150
2141699140,10cyclictest780-21runrttasks20:17:140
2141699140,10cyclictest780-21runrttasks20:00:380
2141699140,10cyclictest780-21runrttasks19:40:560
2141699140,10cyclictest7248-21rm23:45:540
2141699140,10cyclictest7220-21diskstats20:55:160
2141699140,10cyclictest5375-21load20:50:180
2141699140,10cyclictest4223-21sh21:40:060
2141699140,10cyclictest3953-21runrttasks20:47:250
2141699140,10cyclictest382-21sh00:35:520
2141699140,10cyclictest29867-21aten2_r5power_c20:35:110
2141699140,10cyclictest28735-21runrttasks20:30:220
2141699140,10cyclictest27996-21df21:35:130
2141699140,10cyclictest24901-21sh21:50:330
2141699140,10cyclictest20967-21sh00:30:120
2141699140,10cyclictest19962-21sh21:30:210
2141699140,10cyclictest1905-21latency19:35:170
2141699140,10cyclictest13343-21ssh22:02:270
2141699140,10cyclictest11054-21sh00:06:010
2141699140,10cyclictest10215-21tail21:00:190
2141699140,10cyclictest10151-21ssh22:35:430
2912429130,7tAtEmLog_06122-21taskset23:10:005
2395999130,11tDemoTimingTask27741-21chrt00:33:505
2394839130,11EcMasterDemoSyn641-21chrt00:36:045
2143299135,6cyclictest326-21systemd-journal21:50:024
2143299132,8cyclictest6556-21aten2_r5power_v23:10:124
2143299131,9cyclictest31772-21chrt20:38:374
2143299130,9cyclictest9076-21fschecks_count22:00:154
2143299130,9cyclictest8497-21/usr/sbin/munin19:50:204
2143299130,9cyclictest811-21runintdemo5min23:55:434
2143299130,9cyclictest780-21runrttasks23:30:164
2143299130,9cyclictest716-21snmpd19:20:324
2143299130,9cyclictest7022-21cpu20:55:154
2143299130,9cyclictest6142-21/usr/sbin/munin19:45:174
2143299130,9cyclictest441-21cat20:40:164
2143299130,9cyclictest422-21ssh00:35:554
2143299130,9cyclictest3630-21/usr/sbin/munin22:15:234
2143299130,9cyclictest32738-21/usr/sbin/munin21:20:184
2143299130,9cyclictest32443-21sh23:42:104
2143299130,9cyclictest30565-21sh00:17:124
2143299130,9cyclictest30181-21cstates23:05:134
2143299130,9cyclictest28818-21/usr/sbin/munin19:25:174
2143299130,9cyclictest26949-21/usr/sbin/munin22:10:164
2143299130,9cyclictest2617-21/usr/sbin/munin22:50:204
2143299130,9cyclictest2580-21ssh22:31:454
2143299130,9cyclictest25073-21/usr/sbin/munin20:25:154
2143299130,9cyclictest24220-21ssh23:20:014
2143299130,9cyclictest23495-21kernelversion20:20:184
2143299130,9cyclictest21841-21ssh22:25:014
2143299130,9cyclictest20972-21/usr/sbin/munin00:30:134
2143299130,9cyclictest20331-21runrttasks20:15:084
2143299130,9cyclictest17400-21sh23:15:274
2143299130,9cyclictest17004-21diskmemload00:10:034
2143299130,9cyclictest14839-21sh21:10:144
2143299130,9cyclictest1166-21/usr/sbin/munin23:25:144
2143299130,9cyclictest11580-21/usr/sbin/munin21:05:174
2143299130,9cyclictest10888-21taskset21:00:294
2143299130,9cyclictest10304-21sh00:05:314
2143299130,10cyclictest4516-21grep00:20:254
2143299130,10cyclictest3853-21/usr/sbin/munin19:40:154
2143299130,10cyclictest26298-21df_inode22:45:144
2143299130,10cyclictest17271-21users20:05:244
2143299130,10cyclictest12964-21sh21:26:324
2142999135,6cyclictest3432-21if_enp6s022:50:183
2142999131,9cyclictest4585-21sh23:45:103
2142999131,9cyclictest13277-21/usr/sbin/munin20:00:233
2142999130,9cyclictest780-21runrttasks23:50:163
2142999130,9cyclictest4667-21/usr/sbin/munin20:50:153
2142999130,9cyclictest22722-21/usr/sbin/munin20:20:143
2142999130,9cyclictest20827-21diskmemload00:30:063
2142999130,9cyclictest17688-21if_enp6s022:40:173
2142999130,9cyclictest15632-21/usr/sbin/munin20:05:233
2142999130,9cyclictest11210-21diskstats19:55:153
2142999130,9cyclictest10284-21awk21:00:193
2142999130,10cyclictest8465-21ssh23:10:283
2142999130,10cyclictest780-21runrttasks20:49:383
2142999130,10cyclictest4042-21grep19:40:163
2142999130,10cyclictest31527-21df19:30:143
2142999130,10cyclictest27596-21/usr/sbin/munin21:35:193
2142999130,10cyclictest25285-21sensors_volt19:15:223
2142499135,6cyclictest26563-21cpu19:20:132
2142499130,9cyclictest32206-21/usr/sbin/munin20:40:132
2142499130,9cyclictest23730-21sh19:15:002
2142499130,9cyclictest14791-21cat20:00:242
2142499130,8cyclictest23253-21sh21:15:022
2142499130,10cyclictest8551-21aten2_r5power_e19:50:132
2142499130,10cyclictest5948-21apt-key19:45:002
2142499130,10cyclictest31856-21basename19:30:172
2142499130,10cyclictest2731-21gltestperf20:45:142
2142099135,6cyclictest9119-21tune2fs22:00:151
2142099131,9cyclictest7289-21diskmemload21:41:071
2142099131,9cyclictest4689-21tr19:40:221
2142099131,7cyclictest7891-21taskset19:46:401
2142099131,10cyclictest16-1pr/legacy20:07:281
2142099130,9cyclictest9296-21taskset21:25:071
2142099130,9cyclictest8002-21diskmemload00:05:021
2142099130,9cyclictest716-21snmpd20:32:401
2142099130,9cyclictest673-21sh22:30:261
2142099130,9cyclictest5214-21runrttasks20:50:171
2142099130,9cyclictest31172-21/usr/sbin/munin19:30:141
2142099130,9cyclictest30028-21mailstats19:25:201
2142099130,9cyclictest26432-21aten2_r5power_c19:20:131
2142099130,9cyclictest25073-21/usr/sbin/munin20:25:211
2142099130,9cyclictest10058-21sh23:30:071
2142099130,10cyclictest8497-21/usr/sbin/munin19:50:201
2142099130,10cyclictest18757-21ssh23:16:231
2142099130,10cyclictest13420-21/usr/sbin/munin21:45:171
2141699135,6cyclictest7882-21sshd19:46:330
2141699130,9cyclictest780-21runrttasks19:10:200
2141699130,9cyclictest31619-21fschecks_count19:30:150
2141699130,9cyclictest11899-21ntpq19:55:190
2141699130,10cyclictest29174-21df_inode19:25:150
2141699130,10cyclictest28142-21runrttasks19:21:270
1078399130,8tDemoTimingTask10899-21taskset22:54:525
673199120,10tDemoTimingTask7964-21chrt21:24:225
529499120,10tDemoTimingTask7809-21taskset19:45:355
3000639120,1EcMasterDemoSyn651irq_work/523:40:275
2491539120,0EcMasterDemoSyn0-21swapper/523:55:405
2143299120,9cyclictest6134-21grep20:50:274
2143299120,7cyclictest29532-21latency_hist20:35:004
2142999120,9cyclictest21476-21latency_hist19:10:003
2142999120,9cyclictest19644-21runrttasks20:10:313
2142499124,6cyclictest21617-21wc19:10:002
2142499123,7cyclictest20027-21cron20:15:002
2142099120,9cyclictest2575-21fschecks_count20:45:151
1980739120,1EcMasterDemoSyn651irq_work/520:12:325
550039110,0EcMasterDemoSyn0-21swapper/500:21:015
2979939110,0EcMasterDemoSyn0-21swapper/521:53:575
2911439110,0EcMasterDemoSyn0-21swapper/523:04:585
2579939110,0EcMasterDemoSyn0-21swapper/519:16:465
2344439112,7EcMasterDemoSyn23663-21chrt19:14:105
2143299110,8cyclictest21654-21latency_hist19:10:004
2142099110,8cyclictest21437-21latency_hist19:10:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional