You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-01 - 06:01
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Fri May 01, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1412391020,1EcMasterDemoSyn1417-21runintdemo5min21:59:443
160592990,0sleep30-21swapper/322:25:143
171332930,0sleep50-21swapper/521:50:155
1549339930,0EcMasterDemoSyn1550329tAtEmLog_022:25:065
788039920,0EcMasterDemoSyn789029tAtEmLog_021:09:025
1551739840,0EcMasterDemoSyn1552729tAtEmLog_021:49:365
2899939830,0EcMasterDemoSyn2900629tAtEmLog_000:01:295
2671739830,0EcMasterDemoSyn2672729tAtEmLog_019:32:415
1386439830,0EcMasterDemoSyn1387429tAtEmLog_020:13:155
1163339830,0EcMasterDemoSyn1164329tAtEmLog_023:15:505
2619939820,0EcMasterDemoSyn2620929tAtEmLog_000:36:595
2118839820,0EcMasterDemoSyn2119829tAtEmLog_022:45:255
159739820,0EcMasterDemoSyn160729tAtEmLog_023:46:165
94442810,0sleep50-21swapper/523:33:015
3078139560,0EcMasterDemoSyn30789-21runintdemo5min20:48:463
15178993936,2cyclictest23941-21kworker/3:0+events19:47:533
298762350,1sleep30-21swapper/300:20:443
88462330,0sleep40-21swapper/422:03:344
2990439220,1EcMasterDemoSyn29913-21runintdemo5min23:25:593
170339210,1EcMasterDemoSyn1709-21ps19:47:540
2032029190,0tAtEmLog_00-21swapper/521:39:275
15179991814,3cyclictest452-21fschecks_count23:10:144
1517599180,15cyclictest25267-21sh21:19:210
1517599180,14cyclictest326-21systemd-journal23:12:440
1517599180,14cyclictest27661-21sh00:00:320
1517599180,14cyclictest12414-21sh23:16:210
1517599180,10cyclictest9716-21sh00:28:010
803399170,10tDemoTimingTask8124-21chrt00:26:545
2605529170,10tAtEmLog_026060-21chrt20:38:385
1976599170,10tDemoTimingTask28852-21chrt22:14:555
1962699170,7tDemoTimingTask21883-21chrt19:21:125
1517899175,9cyclictest30111-21fschecks_time19:40:143
1517599171,12cyclictest16-1pr/legacy23:41:110
1517599170,9cyclictest6550-21sh21:26:090
1517599170,9cyclictest30761-21sh23:09:130
1517599170,9cyclictest30761-21sh23:09:120
1517599170,9cyclictest30084-21sh00:20:520
1517599170,9cyclictest2977-21ssh22:53:450
1517599170,9cyclictest19267-21sh23:55:590
1517599170,14cyclictest780-21runrttasks22:29:510
3136139160,6EcMasterDemoSyn972-21chrt00:23:105
1726899160,10tDemoTimingTask17299-21chrt19:12:285
1726899160,10tDemoTimingTask17299-21chrt19:12:285
1517899166,6cyclictest18181-21ssh00:15:003
1517899165,6cyclictest4423-21ssh23:48:143
1517899160,9cyclictest17920-21ssh21:32:443
1517899160,10cyclictest12203-21cut21:30:003
15177991612,3cyclictest8910-21cron00:10:002
15177991612,3cyclictest326-21systemd-journal21:45:002
15177991612,3cyclictest1316-21aten2_r5power_c22:35:112
1517799160,10cyclictest32442-21/usr/sbin/munin23:10:162
1517699168,6cyclictest11326-21grep00:10:231
1517599160,7cyclictest18801-21sh21:50:320
142229160,7tAtEmLog_09162-21taskset22:03:465
127552160,5sleep241-21ksoftirqd/222:59:152
1962529150,9tAtEmLog_019630-21chrt19:17:305
1517899155,7cyclictest21437-21ssh23:03:593
1517899154,8cyclictest716-21snmpd20:51:483
1517899154,8cyclictest22431-21missed_timers20:30:193
1517899152,9cyclictest16244-21ssh00:31:183
1517899152,9cyclictest15549-21ssh22:42:303
1517899152,9cyclictest10677-21ssh00:28:423
1517899152,8cyclictest21391-21latency_hist20:30:003
1517899151,9cyclictest3572-21sh23:30:053
15178991511,3cyclictest3210-21unixbench_multi22:35:263
15178991511,3cyclictest21998-21sed19:22:333
1517899150,9cyclictest19476-21sh22:45:033
1517899150,8cyclictest780-21runrttasks20:40:053
1517799151,10cyclictest4153-21ssh21:25:152
1517799151,10cyclictest14342-21/usr/sbin/munin20:15:242
15177991510,3cyclictest7280-21apache200:00:002
1517799150,9cyclictest28747-21/usr/sbin/munin19:35:222
1517799150,11cyclictest25884-21runrttasks20:36:342
1517699153,8cyclictest3036-21cat21:25:001
1517699151,10cyclictest15593-21cpu19:10:121
1517699151,10cyclictest15593-21cpu19:10:121
1517599157,6cyclictest26494-21grep19:30:240
1517599156,7cyclictest26372-21sh23:24:520
1517599156,7cyclictest14455-21aten2_r5power_e23:00:130
1517599153,9cyclictest780-21runrttasks20:19:180
1517599153,9cyclictest6804-21ssh22:55:210
1517599151,7cyclictest16020-21latency_hist23:55:000
15175991511,3cyclictest19862-21turbostat19:20:000
1517599150,7cyclictest17891-21awk00:14:590
1517599150,6cyclictest1150-21taskset22:35:070
1517599150,10cyclictest7321-21cat20:00:140
789029140,0tAtEmLog_00-21swapper/521:14:065
789029140,0tAtEmLog_00-21swapper/521:14:055
1517999146,4cyclictest9380-21kworker/u24:1+xprtiod22:13:554
1517999144,7cyclictest23325-21kworker/u24:4+xprtiod22:05:194
1517999144,5cyclictest19083-21latency_hist20:25:014
1517999143,8cyclictest14157-21missed_timers00:30:184
1517999141,9cyclictest30876-21/usr/sbin/munin21:40:164
1517999141,9cyclictest22300-21df_inode23:40:164
1517999141,9cyclictest18616-21sh21:33:124
1517999141,10cyclictest28212-21sh21:38:334
1517999140,10cyclictest5510-21sh22:37:004
1517999140,10cyclictest5152-21sed21:25:244
1517999140,10cyclictest32732-21sh22:34:444
1517999140,10cyclictest31313-21wget20:50:124
1517999140,10cyclictest27754-21perl23:25:134
1517999140,10cyclictest24036-21sh22:47:064
1517999140,10cyclictest12532-21chrt23:16:274
1517999140,10cyclictest11387-21latency_hist20:10:014
1517999140,10cyclictest10604-21sh21:46:094
1517899145,7cyclictest23537-21/usr/sbin/munin19:25:193
1517899145,5cyclictest16407-21latency_hist20:20:003
1517899144,6cyclictest28004-21sh22:31:223
1517899143,7cyclictest7864-21expr21:45:123
1517899143,7cyclictest7232-21switchtime21:05:243
1517899142,9cyclictest10871-21ssh22:57:553
1517899142,8cyclictest8641-21ssh22:20:283
1517899142,8cyclictest50-21ksoftirqd/321:50:193
1517899142,8cyclictest3985-21tune2fs21:00:163
1517899142,8cyclictest31705-21basename21:40:163
1517899142,8cyclictest3080-21sh00:05:533
1517899142,8cyclictest30220-21sed22:50:233
1517899142,8cyclictest29398-21ssh21:20:523
1517899142,8cyclictest27967-21ssh00:00:443
1517899142,8cyclictest25557-21sh00:36:323
1517899142,8cyclictest22723-21ssh23:22:163
1517899142,8cyclictest2034-21cat20:55:183
1517899142,8cyclictest18170-21sed23:55:243
1517899142,8cyclictest17886-21ssh21:15:143
1517899142,8cyclictest14281-21ssh22:06:013
1517899142,8cyclictest13920-21runrttasks20:13:303
1517899142,8cyclictest10539-21mailstats20:05:193
1517899141,9cyclictest4678-21ssh22:00:403
1517899141,9cyclictest28999-21runrttasks19:36:533
1517899141,9cyclictest21780-21/usr/sbin/munin21:35:113
1517899141,10cyclictest16-1pr/legacy19:12:243
1517899141,10cyclictest16-1pr/legacy19:12:233
1517899140,12cyclictest9166-21aten2_r5power_e23:15:133
1517899140,10cyclictest7528-21/usr/sbin/munin23:50:223
1517899140,10cyclictest6970-21aten2_r5power_e20:00:123
1517899140,10cyclictest32064-21sh22:15:363
1517899140,10cyclictest23667-21rm23:05:153
1517899140,10cyclictest23667-21rm23:05:143
1517899140,10cyclictest22872-21sed23:40:203
1517899140,10cyclictest14961-21ssh23:35:333
1517899140,10cyclictest1036-21memory23:10:173
1517799146,6cyclictest16076-21cut19:10:162
1517799146,6cyclictest16076-21cut19:10:152
1517799146,6cyclictest14733-21tr23:00:132
1517799141,9cyclictest9092-21/usr/sbin/munin23:15:152
1517799141,10cyclictest9839-21sh21:45:372
1517799140,7cyclictest27473-21ssh22:30:592
1517799140,11cyclictest780-21runrttasks19:16:322
1517799140,11cyclictest19130-21/usr/sbin/munin20:25:182
1517799140,10cyclictest8338-21sh22:03:122
1517799140,10cyclictest7895-21ssh23:31:542
1517799140,10cyclictest780-21runrttasks23:37:152
1517799140,10cyclictest780-21runrttasks22:21:292
1517799140,10cyclictest767-21taskset20:53:552
1517799140,10cyclictest6932-21/usr/sbin/munin20:00:132
1517799140,10cyclictest4155-21sh00:25:132
1517799140,10cyclictest3185-21runrttasks20:59:422
1517799140,10cyclictest3107-21rm22:18:022
1517799140,10cyclictest30606-21ssh23:45:012
1517799140,10cyclictest29610-21/usr/sbin/munin19:40:172
1517799140,10cyclictest29581-21sh00:20:312
1517799140,10cyclictest28240-21sh00:00:562
1517799140,10cyclictest27710-21/usr/sbin/munin21:20:182
1517799140,10cyclictest26858-21ssh23:42:342
1517799140,10cyclictest24711-21ssh00:35:572
1517799140,10cyclictest24526-21runrttasks19:29:272
1517799140,10cyclictest23634-21grep21:35:232
1517799140,10cyclictest23000-21sh21:17:482
1517799140,10cyclictest22681-21ssh22:46:092
1517799140,10cyclictest20491-21chrt00:15:292
1517799140,10cyclictest2039-21ssh22:53:062
1517799140,10cyclictest19433-21ssh21:50:592
1517799140,10cyclictest17632-21ssh22:08:232
1517799140,10cyclictest17127-21ssh21:32:112
1517799140,10cyclictest16324-21ssh00:13:542
1517799140,10cyclictest16219-21sh22:25:142
1517799140,10cyclictest14416-21/usr/sbin/munin00:30:212
1517799140,10cyclictest12114-21sh23:52:192
1517799140,10cyclictest10640-21/usr/sbin/munin22:40:152
1517699141,9cyclictest27049-21ssh00:37:331
1517699141,9cyclictest26597-21ssh00:00:181
1517699141,9cyclictest19888-21/usr/sbin/munin23:20:231
1517699141,9cyclictest13037-21ssh22:40:431
1517699141,10cyclictest6647-21ssh21:26:131
1517699141,10cyclictest5050-21ssh22:19:231
1517699141,10cyclictest3326-21ssh23:47:281
1517699141,10cyclictest24164-21ssh22:11:381
1517699140,12cyclictest24410-21sed23:05:201
1517699140,12cyclictest24410-21sed23:05:191
1517699140,12cyclictest12946-21grep21:30:141
1517699140,10cyclictest9754-21ssh22:04:131
1517699140,10cyclictest9492-21ssh21:45:241
1517699140,10cyclictest8528-21users22:20:241
1517699140,10cyclictest7939-21df_inode23:50:161
1517699140,10cyclictest6777-21latency_hist20:00:001
1517699140,10cyclictest5331-21/usr/sbin/munin22:55:161
1517699140,10cyclictest4367-21sh23:30:141
1517699140,10cyclictest3583-21aten2_r5power_e21:00:131
1517699140,10cyclictest32341-21ssh22:51:361
1517699140,10cyclictest3136-21sh23:11:131
1517699140,10cyclictest30876-21/usr/sbin/munin21:40:241
1517699140,10cyclictest30513-21ls21:40:001
1517699140,10cyclictest29728-21ssh00:20:371
1517699140,10cyclictest27235-21/usr/sbin/munin19:35:151
1517699140,10cyclictest25680-21ssh23:41:441
1517699140,10cyclictest25562-21ssh21:55:041
1517699140,10cyclictest25441-21sed22:30:161
1517699140,10cyclictest2515-21sh00:05:281
1517699140,10cyclictest23000-21sh21:53:301
1517699140,10cyclictest22312-21ssh22:45:531
1517699140,10cyclictest21184-21latency_hist20:30:001
1517699140,10cyclictest20080-21sh00:15:251
1517699140,10cyclictest19120-21ssh23:38:291
1517699140,10cyclictest18966-21sh22:26:241
1517699140,10cyclictest17469-21ssh21:15:061
1517699140,10cyclictest12822-21ssh00:30:021
1517699140,10cyclictest12539-21cat00:29:591
1517699140,10cyclictest1027-21ssh22:35:011
1517599148,5cyclictest22410-21grep22:10:250
1517599147,5cyclictest29674-21tr19:40:120
1517599146,6cyclictest5183-21sh21:43:450
1517599146,6cyclictest19452-21/usr/sbin/munin00:15:190
1517599145,7cyclictest8910-21sh22:03:350
1517599145,7cyclictest11719-21apt-config20:10:000
1517599143,8cyclictest326-21systemd-journal19:37:090
1517599143,6cyclictest18913-21latency_hist20:25:000
1517599141,9cyclictest24552-21sh21:35:590
1517599141,9cyclictest15978-21sh21:31:220
1517599141,9cyclictest13796-21sh23:35:180
1517599141,11cyclictest6815-21missed_timers21:05:180
1517599141,11cyclictest24757-21cat19:30:000
1517599141,10cyclictest32105-21sh23:45:180
1517599141,10cyclictest14585-21sh00:30:240
1517599140,7cyclictest30545-21grep22:15:140
1517599140,7cyclictest29220-21df20:45:120
1517599140,7cyclictest28623-21sh21:56:050
1517599140,7cyclictest11257-21perl22:40:140
1517599140,12cyclictest5692-21ssh00:07:430
1517599140,12cyclictest28625-21ssh23:25:220
1517599140,10cyclictest9791-21ssh23:33:150
1517599140,10cyclictest9062-21ssh21:45:200
1517599140,10cyclictest6345-21ssh22:20:040
1517599140,10cyclictest29193-21sh21:20:430
1517599140,10cyclictest27488-21ssh00:37:510
1517599140,10cyclictest26733-21sh22:30:280
1517599140,10cyclictest10620-21sh21:10:290
1517599140,10cyclictest10620-21sh21:10:290
803399130,11tDemoTimingTask16809-21chrt00:31:415
71929130,0tAtEmLog_00-21swapper/520:58:535
2501999130,11tDemoTimingTask32120-21chrt21:22:455
2075429130,0tAtEmLog_00-21swapper/523:23:365
1573229135,0tAtEmLog_00-21swapper/521:15:145
1517999135,6cyclictest711-21gdbus19:55:194
1517999135,6cyclictest32093-21cut19:45:024
1517999135,6cyclictest26885-21aten2_r5power_e21:20:134
1517999131,9cyclictest2843-21diskmemload00:05:434
1517999131,9cyclictest26219-21fschecks_count21:55:144
1517999131,9cyclictest23275-21/usr/sbin/munin00:35:194
1517999131,9cyclictest12987-21ssh23:52:544
1517999131,9cyclictest12830-21diskmemload23:35:124
1517999131,8cyclictest18544-21sh23:20:134
1517999130,9cyclictest9473-21sh22:56:564
1517999130,9cyclictest8426-21ssh21:10:064
1517999130,9cyclictest8426-21ssh21:10:054
1517999130,9cyclictest780-21runrttasks22:20:044
1517999130,9cyclictest780-21runrttasks20:16:444
1517999130,9cyclictest780-21runrttasks00:25:024
1517999130,9cyclictest780-21runrttasks00:00:334
1517999130,9cyclictest4259-21latency_hist19:55:014
1517999130,9cyclictest32263-21/usr/sbin/munin19:45:124
1517999130,9cyclictest30854-21/usr/sbin/munin23:45:204
1517999130,9cyclictest29857-21/usr/sbin/munin22:15:184
1517999130,9cyclictest29549-21ssh00:20:294
1517999130,9cyclictest28860-21chrt20:45:024
1517999130,9cyclictest24931-21aten2_r5power_e19:30:114
1517999130,9cyclictest24747-21latency_hist19:30:014
1517999130,9cyclictest24142-21/usr/sbin/munin20:35:124
1517999130,9cyclictest23856-21/usr/sbin/munin23:05:164
1517999130,9cyclictest23856-21/usr/sbin/munin23:05:164
1517999130,9cyclictest21646-21ssh21:16:514
1517999130,9cyclictest18830-21/usr/sbin/munin19:15:174
1517999130,9cyclictest16474-21/usr/sbin/munin23:55:204
1517999130,9cyclictest15612-21ntpq23:00:194
1517999130,9cyclictest13643-21rm22:41:094
1517999130,9cyclictest11856-21ssh00:10:444
1517999130,7cyclictest171352grep21:50:154
1517999130,10cyclictest30848-21rm22:50:314
1517999130,10cyclictest19796-21/usr/sbin/munin20:25:144
1517999130,10cyclictest18399-21ssh00:15:094
1517999130,10cyclictest16824-21awk22:25:184
1517999130,10cyclictest16495-21ntpq19:10:194
1517999130,10cyclictest16495-21ntpq19:10:194
1517899135,4cyclictest17973-21sensors20:20:193
1517899133,7cyclictest5090-21grep19:55:143
1517899131,9cyclictest10193-21timerandwakeup21:10:233
1517899131,9cyclictest10193-21timerandwakeup21:10:223
1517899131,8cyclictest9364-21sh00:10:073
1517899131,8cyclictest20918-21ssh22:10:133
1517899131,7cyclictest1513150latency_hist19:10:003
1517899131,7cyclictest1513150latency_hist19:10:003
1517899130,9cyclictest2534-21tr19:50:133
1517899130,9cyclictest25093-21missed_timers20:35:163
1517899130,9cyclictest17794-21/usr/sbin/munin19:15:183
1517899130,10cyclictest24879-21/usr/sbin/munin19:30:113
1517799130,9cyclictest9677-21cstates20:05:122
1517799130,9cyclictest780-21runrttasks19:20:052
1517799130,9cyclictest4240-21idleruntime21:00:172
1517799130,9cyclictest3888-21runrttasks19:50:482
1517799130,9cyclictest28937-21runrttasks20:45:122
1517799130,9cyclictest26935-21ssh21:55:182
1517799130,9cyclictest25670-21/usr/sbin/munin19:30:162
1517799130,9cyclictest21487-21/usr/sbin/munin20:30:212
1517799130,9cyclictest20816-21grep22:10:132
1517799130,9cyclictest17888-21ssh23:20:012
1517799130,9cyclictest16818-21runrttasks20:20:112
1517799130,9cyclictest13716-21chrt20:11:232
1517799130,10cyclictest8942-21df_inode21:10:132
1517799130,10cyclictest8942-21df_inode21:10:122
1517799130,10cyclictest32268-21apt-get19:45:112
1517799130,10cyclictest30148-21ssh23:26:082
1517799130,10cyclictest24221-21sh23:05:182
1517799130,10cyclictest24221-21sh23:05:172
1517699139,3cyclictest16401-21sh20:20:001
1517699131,9cyclictest15265-21diskmemload22:06:431
1517699131,7cyclictest26579-21wget20:40:101
1517699130,9cyclictest9335-21/usr/sbin/munin20:05:161
1517699130,9cyclictest9239-21latency_hist20:05:001
1517699130,9cyclictest9012-21sh23:15:091
1517699130,9cyclictest8678-21cpu21:10:121
1517699130,9cyclictest8678-21cpu21:10:111
1517699130,9cyclictest7941-21taskset21:09:211
1517699130,9cyclictest716-21snmpd20:37:281
1517699130,9cyclictest32263-21/usr/sbin/munin19:45:141
1517699130,9cyclictest28871-21/usr/sbin/munin20:45:181
1517699130,9cyclictest27114-21/usr/sbin/munin23:25:141
1517699130,9cyclictest25556-21hddtemp_smartct19:30:151
1517699130,9cyclictest23123-21uptime20:30:261
1517699130,9cyclictest22524-21/usr/sbin/munin19:25:121
1517699130,9cyclictest20170-21/usr/sbin/munin19:20:131
1517699130,9cyclictest16725-21/usr/sbin/munin20:20:241
1517699130,9cyclictest14391-21/usr/sbin/munin23:00:131
1517699130,9cyclictest1165-21/usr/sbin/munin20:55:201
1517699130,7cyclictest29996-21grep19:40:141
1517699130,10cyclictest17794-21/usr/sbin/munin19:15:191
1517699130,10cyclictest16235-21rm23:55:011
1517699130,10cyclictest12928-21sed20:10:201
1517599135,7cyclictest780-21runrttasks20:37:580
1517599135,6cyclictest15930-21cut19:10:140
1517599135,6cyclictest15930-21cut19:10:140
1517599130,9cyclictest780-21runrttasks20:57:350
1517599130,9cyclictest5236-21idleruntime19:55:150
1517599130,9cyclictest19416-21ssh22:45:010
1517599130,9cyclictest12471-21diskmemload22:05:160
1517599130,7cyclictest5158-21sed21:00:250
1517599130,7cyclictest174-1kworker/0:1H+kblockd20:26:580
1517599130,7cyclictest174-1kworker/0:1H+kblockd19:22:230
1517599130,7cyclictest15300-21cat19:10:000
1517599130,7cyclictest15300-21cat19:10:000
1517599130,11cyclictest11994-21/usr/sbin/munin20:10:110
1517599130,10cyclictest436-21runrttasks20:50:430
1517599130,10cyclictest26737-21ls20:40:120
1517599130,10cyclictest22672-21mailstats20:30:200
1517599130,10cyclictest2246-21cut19:50:110
629729120,11tAtEmLog_011982-21chrt22:22:505
404699120,10tDemoTimingTask6136-21taskset00:08:015
3145539120,0EcMasterDemoSyn0-21swapper/519:42:515
2891999121,9tDemoTimingTask31956-21chrt22:15:325
2577629120,1tAtEmLog_0323712sleep523:10:095
2466299121,9tDemoTimingTask30847-21chrt22:33:235
2435339120,0EcMasterDemoSyn0-21swapper/519:27:375
188399120,10tDemoTimingTask4315-21taskset21:25:175
1665339120,0EcMasterDemoSyn0-21swapper/523:00:375
1624429120,10tAtEmLog_016362-21chrt20:19:345
1517999128,3cyclictest27521-21cpuspeed_turbos19:35:114
1517999120,9cyclictest5894-21/usr/sbin/munin21:05:154
1517999120,9cyclictest3792-21cut21:00:154
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional