You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-10 - 12:00
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Wed Dec 10, 2025 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1154839910,0EcMasterDemoSyn1155829tAtEmLog_020:47:535
174039850,0EcMasterDemoSyn175329tAtEmLog_023:40:195
1626439840,0EcMasterDemoSyn1627429tAtEmLog_020:58:015
1648039830,0EcMasterDemoSyn1649029tAtEmLog_022:09:015
814139820,0EcMasterDemoSyn815129tAtEmLog_019:31:505
445439820,0EcMasterDemoSyn446429tAtEmLog_020:32:405
1390839820,0EcMasterDemoSyn1391829tAtEmLog_020:52:585
98339810,0EcMasterDemoSyn99329tAtEmLog_019:16:365
3103539810,0EcMasterDemoSyn3104529tAtEmLog_019:11:335
2498739810,0EcMasterDemoSyn2499729tAtEmLog_020:07:195
2409939810,0EcMasterDemoSyn2410929tAtEmLog_022:54:405
2409939810,0EcMasterDemoSyn2410929tAtEmLog_022:54:395
2367039810,0EcMasterDemoSyn2368129tAtEmLog_022:34:225
57442560,1sleep2391rcuc/221:40:192
371539380,0EcMasterDemoSyn0-21swapper/000:00:360
2099939290,1EcMasterDemoSyn21008-21runintdemo5min21:08:092
28739992421,2cyclictest11964-21kworker/4:0+events22:49:354
168752210,0sleep20-21swapper/221:48:072
2873299201,7cyclictest2288350latency_hist20:04:592
2873299201,14cyclictest13688-21sh22:47:542
59799191,15tDemoTimingTask4949-21chrt22:00:365
2873299190,8cyclictest9986-21sh23:45:162
2873299190,7cyclictest30399-21ssh23:57:342
2873299190,6cyclictest150391ssh22:28:332
2872399195,10cyclictest3219-21sh22:41:250
2873299181,7cyclictest842350latency_hist19:35:002
2873299180,7cyclictest28854-21needreboot20:15:222
2873299180,7cyclictest1815850latency_hist19:55:002
2873299180,6cyclictest21805-21sh00:14:452
2873299180,11cyclictest4303-21ssh23:41:352
2873299180,11cyclictest23532-21df20:05:152
2872399180,15cyclictest27424-21sh00:18:060
2872399180,14cyclictest2760-21sh21:17:590
2872399180,14cyclictest11681-21sh23:26:470
2872399180,10cyclictest31325-21sh23:58:240
1591539180,0EcMasterDemoSyn15922-21grep22:29:190
1101529180,11tAtEmLog_013148-21chrt21:25:005
734399170,7tDemoTimingTask12722-21chrt22:47:095
2873999171,12cyclictest16-1pr/legacy21:58:524
2873999171,12cyclictest16-1pr/legacy20:47:514
2873299172,8cyclictest23815-21ssh21:52:292
2873299171,8cyclictest29264-21packagekitd19:10:002
2873299171,8cyclictest11868-21ssh23:06:432
2873299171,7cyclictest15134-21timerwakeupswit21:25:282
2873299171,6cyclictest17374-21head21:00:172
2873299170,7cyclictest8109-21sh22:03:242
2873299170,7cyclictest2868-21chrt19:20:232
2873299170,7cyclictest2868-21chrt19:20:222
2873299170,7cyclictest249861ssh21:11:302
2873299170,6cyclictest87031gltestperf23:25:152
2873299170,6cyclictest7137-21ssh23:24:502
2873299170,3cyclictest22521-21ssh23:14:102
2873299170,15cyclictest10911-21which20:45:222
2873299170,12cyclictest5225-21ssh23:02:432
2872899171,9cyclictest17034-21sh23:49:581
2872399174,9cyclictest805-21runrttasks23:42:170
2872399170,9cyclictest20169-21sh23:31:480
2872399170,9cyclictest17016-21sh21:48:150
2872399170,14cyclictest29662-21sh22:57:320
2872399170,14cyclictest23986-21sh23:15:080
2837029171,14tAtEmLog_028565-21chrt19:08:415
769299160,9tDemoTimingTask8242-21taskset23:05:005
734399162,11tDemoTimingTask7381-21chrt22:44:325
32139991616,0tDemoTimingTask0-21swapper/522:59:455
28739991613,2cyclictest11964-21kworker/4:0+events20:27:364
28737991612,3cyclictest8014-21cron22:44:593
2873799160,10cyclictest5793-21python321:40:213
2873299166,5cyclictest29411-21sh22:57:212
2873299165,9cyclictest6176-21mailstats20:35:202
2873299165,9cyclictest1495-21grep20:25:262
2873299164,10cyclictest7695-21seq20:40:132
2873299164,10cyclictest14758-21seq20:55:152
2873299161,8cyclictest975-21/usr/sbin/munin22:40:172
2873299161,8cyclictest19325-21runrttasks22:51:012
2873299161,8cyclictest19325-21runrttasks22:51:002
2873299161,7cyclictest9638-21missed_timers19:35:182
2873299161,7cyclictest27715-21ssh23:16:532
2873299161,7cyclictest2490250latency_hist00:40:012
2873299161,7cyclictest2490250latency_hist00:40:012
2873299160,8cyclictest7258-21sed21:20:232
2873299160,8cyclictest5086-21sh00:25:112
2873299160,8cyclictest32119-21sh21:36:312
2873299160,8cyclictest30753-21grep00:20:172
2873299160,8cyclictest30482-21ssh21:56:352
2873299160,8cyclictest28970-21cat19:10:012
2873299160,8cyclictest27534-21ssh21:34:142
2873299160,8cyclictest26591-21head22:15:152
2873299160,8cyclictest25630-21fschecks_time23:35:172
2873299160,8cyclictest25286-21expr22:35:172
2873299160,8cyclictest23586-21chrt22:13:302
2873299160,8cyclictest23324-21sh23:34:132
2873299160,8cyclictest17921-21expr23:50:122
2873299160,8cyclictest15839-21sed19:50:002
2873299160,8cyclictest15199-21cron00:09:592
2873299160,7cyclictest7218-21ssh22:23:482
2873299160,6cyclictest21187-21diskmemload00:17:222
2873299160,6cyclictest18121-21if_err_enp5s022:30:192
2873299160,4cyclictest30011-21ssh21:15:132
2872899169,5cyclictest20307-21wc21:05:201
2872899165,8cyclictest334-21systemd-journal19:39:571
28728991610,5cyclictest15775-21runintdemo5min22:49:371
2872399163,9cyclictest13832-21sh00:08:390
2872399160,9cyclictest805-21runrttasks20:01:280
2872399160,9cyclictest16135-21aten2_r5power_c19:50:130
2872399160,7cyclictest4687-21awk20:35:000
2872399160,13cyclictest805-21runrttasks00:37:230
2872399160,13cyclictest805-21runrttasks00:37:230
2482099160,9tDemoTimingTask29439-21taskset00:19:565
1786199160,9tDemoTimingTask17944-21taskset00:10:475
1098929160,14tAtEmLog_011460-21taskset00:06:115
3215129150,9tAtEmLog_032172-21taskset22:19:105
2873999157,7cyclictest28719-21cyclictest21:42:114
2873999154,8cyclictest2878-21grep22:00:134
2873999150,9cyclictest27046-21ssh22:15:174
2873799159,5cyclictest10905-21apt-config19:40:003
2873799158,6cyclictest17828-21grep22:50:183
2873799158,6cyclictest17828-21grep22:50:173
2873799154,9cyclictest16-1pr/legacy20:27:353
2873799154,6cyclictest11744-21cron20:50:003
2873799150,10cyclictest6861-21ssh23:04:073
2873799150,10cyclictest13457-21rm22:06:243
2873299154,9cyclictest12104-21cut00:30:122
2873299151,7cyclictest25893-21df_inode20:10:162
2873299150,8cyclictest4318-21grep19:25:142
2873299150,8cyclictest18538-21cut19:55:132
2873299150,7cyclictest31998-21/usr/sbin/munin19:15:152
2873299150,7cyclictest30613-21ls20:20:142
2873299150,7cyclictest1852-21cpuspeed_turbos00:00:142
2873299150,7cyclictest12492-21fschecks_count20:50:172
2873299150,7cyclictest12356-21needreboot19:40:172
2873299150,7cyclictest10448-21ssh22:05:102
2873299150,13cyclictest2862-21grep20:30:132
2872899157,6cyclictest11779-21wc20:50:011
2872899152,9cyclictest6760-21ssh21:40:521
2872899151,10cyclictest31760-21aten2_r5power_v19:15:151
2872899150,11cyclictest18346-21ls19:55:011
2872399157,6cyclictest18726-21tr19:55:130
2872399156,7cyclictest32431-21df23:20:150
2872399156,7cyclictest11291-21sh21:23:370
2872399155,6cyclictest396-21systemctl19:15:220
2872399153,6cyclictest3950-21apache222:22:010
2872399152,10cyclictest8637-21ssh00:27:120
2872399151,7cyclictest10085-21/usr/sbin/munin23:05:250
2872399150,7cyclictest17298-21sed00:10:250
2872399150,6cyclictest20708-21sed21:30:010
2872399150,13cyclictest29257-21apt-get19:10:000
2872399150,12cyclictest805-21runrttasks19:30:560
2872399150,11cyclictest28762-21sh23:36:510
2872399150,10cyclictest23689-21ssh23:53:320
2535029150,6tAtEmLog_029234-21taskset21:55:315
780929140,5tAtEmLog_015308-21taskset23:29:355
2873999145,8cyclictest2864-21/usr/sbin/munin19:20:224
2873999145,8cyclictest2864-21/usr/sbin/munin19:20:214
2873999145,8cyclictest17932-21/usr/sbin/munin22:30:184
2873999141,9cyclictest6985-21sh00:25:284
2873999141,9cyclictest24180-21ssh22:14:024
2873999141,9cyclictest19132-21/usr/sbin/munin21:05:194
2873999141,10cyclictest30378-21/usr/sbin/munin21:35:224
2873999141,10cyclictest28319-21runrttasks21:34:554
2873999140,12cyclictest1971-21ntpq23:40:194
2873999140,10cyclictest8049-21ssh22:24:234
2873999140,10cyclictest28389-21sh23:17:244
2873999140,10cyclictest24649-21diskmemload21:11:144
2873999140,10cyclictest24359-21ssh21:52:564
2873999140,10cyclictest23539-21latency_hist23:15:014
2873999140,10cyclictest23464-21ssh00:38:314
2873999140,10cyclictest23464-21ssh00:38:304
2873999140,10cyclictest19067-21ssh23:30:584
2873999140,10cyclictest11974-21ssh00:30:114
2873999140,10cyclictest11414-21ssh00:06:074
2873799147,6cyclictest28719-21cyclictest19:59:223
2873799143,8cyclictest20896-21apt-key21:30:003
2873799142,9cyclictest754-21lldpd20:58:143
2873799141,9cyclictest30016-21/usr/sbin/munin21:15:173
2873799141,9cyclictest26675-21idleruntime23:55:203
2873799141,9cyclictest26231-21ssh00:17:033
2873799141,9cyclictest15587-21ssh21:46:583
2873799141,7cyclictest29176-21sh21:35:143
2873799141,10cyclictest1287-21fschecks_time23:40:153
2873799140,9cyclictest2107-21/usr/sbin/munin22:20:183
2873799140,10cyclictest9460-21missed_timers23:05:183
2873799140,10cyclictest9221-21apt23:45:123
2873799140,10cyclictest805-21runrttasks23:12:363
2873799140,10cyclictest805-21runrttasks21:51:443
2873799140,10cyclictest805-21runrttasks00:29:263
2873799140,10cyclictest6151-21ssh21:20:133
2873799140,10cyclictest30437-21sh21:56:333
2873799140,10cyclictest28175-21ssh22:15:453
2873799140,10cyclictest27007-21sh23:35:313
2873799140,10cyclictest24340-21rm23:54:093
2873799140,10cyclictest23981-21taskset21:10:433
2873799140,10cyclictest21404-21sh23:32:443
2873799140,10cyclictest1977-21df00:00:143
2873799140,10cyclictest15399-21sh22:49:183
2873799140,10cyclictest13359-21sh21:25:133
2873799140,10cyclictest11506-21sh22:25:353
2872899146,6cyclictest17946-21taskset22:10:011
2872899144,8cyclictest1966-21/usr/sbin/munin23:40:201
2872899143,8cyclictest24935-21basename00:40:001
2872899143,8cyclictest24935-21basename00:40:001
2872899142,8cyclictest18937-21cut19:55:141
2872899141,9cyclictest8352-21sh23:05:061
2872899141,9cyclictest31314-21ssh23:38:551
2872899141,9cyclictest3124-21diskmemload00:23:541
2872899141,9cyclictest17301-21/usr/sbin/munin22:30:241
2872899141,10cyclictest16988-21sh00:10:211
2872899141,10cyclictest16743-21sh22:50:121
2872899141,10cyclictest16743-21sh22:50:111
2872899140,12cyclictest11475-21ssh22:05:191
2872899140,11cyclictest30413-21rm23:19:081
2872899140,10cyclictest8430-21ssh21:21:061
2872899140,10cyclictest805-21runrttasks19:10:121
2872899140,10cyclictest7341-21runrttasks20:40:071
2872899140,10cyclictest7262-21sh22:23:501
2872899140,10cyclictest7029-21runrttasks22:02:281
2872899140,10cyclictest5554-21ssh22:43:101
2872899140,10cyclictest5291-21ssh23:23:241
2872899140,10cyclictest31843-21latency_hist22:39:591
2872899140,10cyclictest30764-21sh23:57:531
2872899140,10cyclictest30268-21/usr/sbin/munin20:20:141
2872899140,10cyclictest29075-21apt-config19:10:011
2872899140,10cyclictest28180-21ssh22:56:181
2872899140,10cyclictest2805-21ntpq00:00:201
2872899140,10cyclictest28019-21ssh21:55:161
2872899140,10cyclictest26554-21sh21:33:241
2872899140,10cyclictest25898-21/usr/sbin/munin22:15:181
2872899140,10cyclictest22743-21memory21:10:201
2872899140,10cyclictest22539-21/usr/sbin/munin00:15:161
2872899140,10cyclictest18244-21latency_hist00:35:001
2872899140,10cyclictest14619-21ssh22:28:111
2872899140,10cyclictest13697-21ssh23:28:201
2872899140,10cyclictest12897-21sh00:07:391
2872899140,10cyclictest12745-21/usr/sbin/munin21:45:161
2872399146,6cyclictest30516-21grep00:20:160
2872399146,3cyclictest1864439EcMasterDemoSyn21:03:050
2872399145,7cyclictest31050-21sh22:18:130
2872399145,7cyclictest25689-21hddtemp_smartct22:35:180
2872399143,8cyclictest2871-21swap19:20:230
2872399143,8cyclictest2871-21swap19:20:230
2872399143,8cyclictest20219-21open_inodes21:05:190
2872399143,6cyclictest27336-21aten2_r5power_e21:55:130
2872399141,9cyclictest8359-21sh22:45:040
2872399141,9cyclictest29228-21cpuspeed_turbos21:35:150
2872399141,9cyclictest21989-21sh21:50:530
2872399141,11cyclictest9577-21cat20:45:010
2872399141,11cyclictest2262-21latency_hist20:30:000
2872399141,10cyclictest805-21runrttasks19:44:480
2872399141,10cyclictest25878-21cstates20:10:160
2872399140,7cyclictest4887-21/usr/sbin/munin19:25:180
2872399140,7cyclictest24142-21sh21:10:510
2872399140,7cyclictest1009-21df23:00:150
2872399140,11cyclictest27171-21diskmemload21:33:550
2872399140,10cyclictest9995-21ls23:45:170
2872399140,10cyclictest6293-21ssh22:01:490
2872399140,10cyclictest5081-21hddtemp_smartct21:40:140
2872399140,10cyclictest22565-21ssh23:14:130
2872399140,10cyclictest18540-21/usr/sbin/munin22:30:220
2872399140,10cyclictest18008-21sh22:10:040
2872399140,10cyclictest10387-21sh22:05:070
1101699140,8tDemoTimingTask5243-21sleep21:24:555
769129130,11tAtEmLog_07697-21chrt23:04:495
2873999136,5cyclictest30714-21timerandwakeup19:10:244
2873999135,6cyclictest28816-21grep20:15:224
2873999131,9cyclictest27216-21runrttasks20:10:494
2873999130,9cyclictest8480-21/usr/sbin/munin23:05:184
2873999130,9cyclictest805-21runrttasks19:50:144
2873999130,9cyclictest805-21runrttasks19:36:364
2873999130,9cyclictest8024-21taskset19:30:274
2873999130,9cyclictest7396-21/usr/sbin/munin20:40:134
2873999130,9cyclictest738-21snmpd00:20:134
2873999130,9cyclictest5758-21/usr/sbin/munin21:20:194
2873999130,9cyclictest4971-21/usr/sbin/munin20:35:184
2873999130,9cyclictest4424-21chrt20:32:254
2873999130,9cyclictest425-21sensors_temp19:15:224
2873999130,9cyclictest4012-21/usr/sbin/munin19:25:174
2873999130,9cyclictest32731-21ssh21:16:044
2873999130,9cyclictest32469-21cut22:40:114
2873999130,9cyclictest32048-21/usr/sbin/munin23:20:144
2873999130,9cyclictest25714-21ssh23:55:054
2873999130,9cyclictest25683-21sh00:16:334
2873999130,9cyclictest24944-21/usr/sbin/munin23:35:194
2873999130,9cyclictest24941-21/usr/sbin/munin22:35:244
2873999130,9cyclictest23183-21/usr/sbin/munin20:05:134
2873999130,9cyclictest19749-21ssh23:50:324
2873999130,9cyclictest17241-21timerandwakeup00:10:254
2873999130,9cyclictest16828-21aten2_r5power_e21:00:144
2873999130,9cyclictest15950-21/usr/sbin/munin20:55:264
2873999130,9cyclictest15845-21ssh21:47:124
2873999130,9cyclictest1574-21rm00:00:114
2873999130,9cyclictest15420-21taskset19:45:354
2873999130,9cyclictest1412-21sendmail-mta23:01:444
2873999130,9cyclictest13409-21/usr/sbin/munin21:25:244
2873999130,9cyclictest12423-21ssh22:26:204
2873999130,9cyclictest12056-21/usr/sbin/munin20:50:204
2873999130,9cyclictest11397-21/usr/sbin/munin19:40:124
2873999130,9cyclictest10491-21/usr/sbin/munin22:05:204
2873999130,10cyclictest9167-21ssh23:45:084
2873999130,10cyclictest25175-21ssh22:55:144
2873999130,10cyclictest22573-21runrttasks20:01:394
2873999130,10cyclictest19671-21sendmail_mailtr19:55:204
2873999130,10cyclictest17152-21fschecks_count22:50:154
2873999130,10cyclictest17152-21fschecks_count22:50:144
2873999130,10cyclictest10547-21ssh23:25:554
2873799133,8cyclictest16828-21/usr/sbin/munin19:50:163
2873799130,9cyclictest8955-21/usr/sbin/munin00:05:223
2873799130,9cyclictest805-21runrttasks20:02:253
2873799130,9cyclictest805-21runrttasks19:30:063
2873799130,9cyclictest805-21runrttasks00:35:073
2873799130,9cyclictest805-21runrttasks00:35:073
2873799130,9cyclictest7704-21sh23:25:013
2873799130,9cyclictest6669-21ssh22:02:073
2873799130,9cyclictest4971-21/usr/sbin/munin20:35:203
2873799130,9cyclictest4588-21runrttasks20:34:003
2873799130,9cyclictest4012-21/usr/sbin/munin19:25:163
2873799130,9cyclictest31697-21cat20:20:253
2873799130,9cyclictest29983-21ssh00:20:073
2873799130,9cyclictest29650-21runrttasks20:16:483
2873799130,9cyclictest26108-21ssh22:35:223
2873799130,9cyclictest25076-21rm22:55:103
2873799130,9cyclictest25002-21runrttasks20:07:203
2873799130,9cyclictest23910-21ssh23:15:043
2873799130,9cyclictest18979-21kernelversion22:10:163
2873799130,9cyclictest18140-21timerandwakeup21:00:253
2873799130,9cyclictest15690-21/usr/sbin/munin00:10:153
2873799130,9cyclictest15615-21runrttasks19:47:343
2873799130,9cyclictest13840-21sh00:30:263
2873799130,9cyclictest11397-21/usr/sbin/munin19:40:163
2873799130,10cyclictest9257-21runrttasks20:43:123
2873799130,10cyclictest619-21missed_timers23:20:193
2873799130,10cyclictest29279-21runrttasks19:10:053
2873799130,10cyclictest19371-21ssh22:30:373
2873799130,10cyclictest10407-21cat20:45:183
2872899135,6cyclictest12588-21fschecks_time20:50:171
2872899131,9cyclictest738-21snmpd00:25:151
2872899130,9cyclictest805-21runrttasks21:26:091
2872899130,9cyclictest6366-21/usr/sbin/munin19:30:211
2872899130,9cyclictest5726-21irqstats20:35:161
2872899130,9cyclictest568-21/usr/sbin/munin23:00:131
2872899130,9cyclictest4355-21runrttasks20:31:321
2872899130,9cyclictest4012-21/usr/sbin/munin19:25:251
2872899130,9cyclictest32493-21sh21:36:501
2872899130,9cyclictest29782-21ssh21:15:011
2872899130,9cyclictest28009-21cpu20:15:171
2872899130,9cyclictest25536-21/usr/sbin/munin20:10:151
2872899130,9cyclictest23868-21basename20:05:181
2872899130,9cyclictest19340-21chrt21:50:021
2872899130,9cyclictest1913-21taskset20:26:031
2872899130,9cyclictest17852-21ntpq21:00:201
2872899130,9cyclictest17120-21kernelversion23:10:191
2872899130,9cyclictest14876-21fschecks_time20:55:181
2872899130,9cyclictest13754-21/usr/sbin/munin19:45:151
2872899130,10cyclictest7803-21sed23:30:091
2872899130,10cyclictest3295-21chrt19:20:521
2872899130,10cyclictest3295-21chrt19:20:521
2872899130,10cyclictest22090-21/usr/sbin/munin20:00:241
2872899130,10cyclictest17476-21sh23:50:021
2872899130,10cyclictest11713-21expr19:40:121
2872399130,9cyclictest805-21runrttasks19:36:280
2872399130,9cyclictest6233-21chrt20:35:220
2872399130,9cyclictest29561-21taskset20:15:380
2872399130,9cyclictest24297-21proc_pri20:05:210
2872399130,7cyclictest146-1kworker/0:1H+kblockd20:45:300
2872399130,11cyclictest17454-21hddtemp_smartct22:50:150
2872399130,11cyclictest17454-21hddtemp_smartct22:50:140
2872399130,10cyclictest146-1kworker/0:1H+kblockd20:50:070
2872399130,10cyclictest146-1kworker/0:1H+kblockd20:20:380
2872399130,10cyclictest14413-21apt-get20:55:140
2872399130,10cyclictest14134-21fschecks_count19:45:140
2872399130,10cyclictest12656-21grep00:30:150
2099939130,1EcMasterDemoSyn0-21swapper/521:08:105
1790629130,3tAtEmLog_017995-21chrt19:52:555
1756039130,3EcMasterDemoSyn22113-21chrt21:50:595
577739120,0EcMasterDemoSyn0-21swapper/519:26:455
3215299120,10tDemoTimingTask4264-21taskset22:21:235
2873999122,5cyclictest30870-21grep20:20:164
2873799120,9cyclictest974-21runintdemo5min19:16:353
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional