You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-25 - 01:58
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Sat Apr 25, 2026 00:43:56)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
18848391830,1EcMasterDemoSyn18854-21runintdemo5min23:55:162
493939930,0EcMasterDemoSyn494929tAtEmLog_020:57:475
264522850,0sleep10-21swapper/122:11:571
510939830,0EcMasterDemoSyn511929tAtEmLog_022:54:265
2518539830,0EcMasterDemoSyn2519529tAtEmLog_020:32:265
2418139820,0EcMasterDemoSyn2419129tAtEmLog_022:29:045
3232639810,0EcMasterDemoSyn3233629tAtEmLog_023:45:075
3228039810,0EcMasterDemoSyn3229029tAtEmLog_020:47:395
2883839810,0EcMasterDemoSyn2884829tAtEmLog_000:00:205
2754239810,0EcMasterDemoSyn2755229tAtEmLog_020:37:305
2282539810,0EcMasterDemoSyn2283529tAtEmLog_020:27:225
1936039810,0EcMasterDemoSyn1937029tAtEmLog_019:11:185
2754239630,0EcMasterDemoSyn0-21swapper/220:37:302
2484839300,4EcMasterDemoSyn24856-21grep21:53:352
120139230,0EcMasterDemoSyn1210-21runintdemo5min19:41:432
204332210,0sleep40-21swapper/421:50:284
1735899190,10cyclictest11745-21sh21:28:280
1735899181,13cyclictest16-1pr/legacy20:22:160
1735899180,14cyclictest4529-21sh00:23:200
1735899180,14cyclictest28503-21sh22:13:250
1735899180,10cyclictest3457-21sh23:46:280
1735899180,10cyclictest22629-21sh00:33:330
32599170,10tDemoTimingTask334-21chrt23:09:385
2485999170,7tDemoTimingTask25049-21chrt21:53:405
1870599170,7tDemoTimingTask19175-21taskset00:31:055
1736499170,12cyclictest16-1pr/legacy23:24:503
17360991714,2cyclictest17224-21kworker/2:0+events23:09:382
17360991711,4cyclictest12522-21sed22:40:162
1736099171,12cyclictest16-1pr/legacy22:18:542
1735899176,6cyclictest1854-21diskstats23:10:110
1735899175,9cyclictest8398-21latency00:25:180
1735899174,9cyclictest780-21runrttasks19:15:010
17358991713,3cyclictest19558-21grep21:50:180
1735899170,9cyclictest780-21runrttasks22:08:560
1735899170,9cyclictest25903-21sh23:59:260
1735899170,9cyclictest15317-21sh00:10:420
1735899170,9cyclictest12354-21sh21:46:080
1735899170,14cyclictest6567-21sh00:05:520
1735899170,14cyclictest20308-21sh23:02:100
1735899170,14cyclictest15896-21sh22:24:340
1735899170,14cyclictest12640-21sh22:04:570
1394829170,9tAtEmLog_014308-21taskset23:35:015
833699160,9tDemoTimingTask8358-21taskset19:56:595
2806639160,14EcMasterDemoSyn4150-21taskset23:29:305
2806639160,14EcMasterDemoSyn4150-21taskset23:29:295
2485999160,6tDemoTimingTask28482-21taskset21:55:165
1870599160,6tDemoTimingTask25076-21chrt00:35:055
17369991612,3cyclictest711-21gdbus23:35:014
17369991612,3cyclictest711-21gdbus23:35:004
1736999160,10cyclictest780-21runrttasks21:00:164
1736499168,6cyclictest981-21grep20:50:123
1735999168,6cyclictest28693-21grep20:40:151
1735999163,9cyclictest861-21cpuspeed20:50:121
1735999161,11cyclictest29560-21sh00:00:311
1735999160,8cyclictest31625-21ssh21:56:571
1735899168,6cyclictest10920-21grep23:15:130
1735899164,9cyclictest26111-21sh23:40:490
1735899160,9cyclictest780-21runrttasks20:29:420
1735899160,9cyclictest780-21runrttasks19:36:140
1735899160,7cyclictest17799-21sh21:14:090
1735899160,14cyclictest21150-21sh23:38:440
1735899160,13cyclictest780-21runrttasks19:55:260
1735899160,13cyclictest2677-21sh21:59:220
1735899160,11cyclictest21328-21cat21:15:240
1336039160,0EcMasterDemoSyn0-21swapper/520:07:055
511929150,6tAtEmLog_08729-21taskset22:55:235
253829150,9tAtEmLog_032505-21sleep20:54:555
1736999157,6cyclictest7193-21sed19:55:144
1736999151,11cyclictest32504-21ssh22:33:344
1736999150,9cyclictest12462-21ssh00:27:404
1736499154,8cyclictest3377-21fschecks_time22:35:143
1736499154,8cyclictest25576-21sed20:35:003
1736499151,10cyclictest11009-21sh23:50:253
1736499150,7cyclictest32588-21/usr/sbin/munin19:40:163
1736499150,13cyclictest22186-21ssh22:27:393
1736499150,10cyclictest22410-21/usr/sbin/munin19:20:163
1736099158,5cyclictest15193-21tr21:30:162
1736099158,5cyclictest15193-21tr21:30:152
1736099157,6cyclictest28444-21sh20:40:132
1736099154,6cyclictest8710-21date23:50:012
17360991511,3cyclictest23949-21cpuspeed_turbos21:35:142
17360991511,3cyclictest23949-21cpuspeed_turbos21:35:132
1736099151,11cyclictest16-1pr/legacy22:13:512
1736099151,10cyclictest14166-21latency_hist21:30:002
1736099150,8cyclictest9011-21ssh23:14:192
1736099150,10cyclictest7366-21chrt21:02:592
1736099150,10cyclictest24374-21ssh21:17:262
1735999157,6cyclictest10939-21grep21:45:241
1735999154,8cyclictest5922-21cut22:23:581
1735999151,10cyclictest29159-21chrt19:34:571
1735999151,10cyclictest17625-21/usr/sbin/munin19:10:181
1735999150,10cyclictest24638-21ssh00:34:591
1735899159,4cyclictest16-1pr/legacy00:00:180
1735899155,6cyclictest7599-21cat22:19:590
1735899153,9cyclictest755-21postgres19:33:110
1735899151,9cyclictest16-1pr/legacy20:02:000
1735899150,10cyclictest29924-21ssh00:37:190
1998429140,8tAtEmLog_022055-21taskset22:10:025
1736999144,8cyclictest26005-21/usr/sbin/munin19:25:204
1736999141,9cyclictest5676-21ssh23:48:014
1736999141,9cyclictest5041-21sed00:05:174
1736999141,9cyclictest20649-21/usr/sbin/munin19:15:154
1736999141,10cyclictest32439-21runrttasks20:49:194
1736999141,10cyclictest18218-21seq00:12:514
1736999140,9cyclictest22919-21diskmemload23:57:174
1736999140,9cyclictest18894-21ssh22:44:044
1736999140,12cyclictest19553-21/usr/sbin/munin21:15:124
1736999140,10cyclictest9972-21ssh21:27:154
1736999140,10cyclictest9643-21ssh23:14:464
1736999140,10cyclictest8990-21ssh23:50:114
1736999140,10cyclictest5338-21sh22:35:494
1736999140,10cyclictest32020-21sh22:50:344
1736999140,10cyclictest31585-21ssh23:25:584
1736999140,10cyclictest31585-21ssh23:25:574
1736999140,10cyclictest28498-21sh22:49:264
1736999140,10cyclictest24668-21chrt21:35:184
1736999140,10cyclictest24668-21chrt21:35:184
1736999140,10cyclictest17317-21ssh23:35:594
1736999140,10cyclictest14325-21sh21:47:324
1736499145,8cyclictest760-21/usr/sbin/munin22:15:243
1736499145,5cyclictest23807-21cpuspeed21:35:143
1736499145,5cyclictest23807-21cpuspeed21:35:133
1736499143,8cyclictest716-21snmpd00:04:083
1736499141,9cyclictest8907-21runrttasks20:00:013
1736499141,9cyclictest28150-21sh22:30:293
1736499141,9cyclictest25951-21sh23:40:423
1736499141,9cyclictest17818-21sh23:00:253
1736499141,9cyclictest15103-21ssh23:17:153
1736499141,9cyclictest12004-21runrttasks22:57:433
1736499141,9cyclictest10891-21ssh21:45:233
1736499141,10cyclictest32409-21sh23:26:323
1736499141,10cyclictest32409-21sh23:26:313
1736499141,10cyclictest16-1pr/legacy00:05:223
1736499141,10cyclictest12565-21needreboot20:05:183
1736499140,12cyclictest18211-21sh21:50:033
1736499140,12cyclictest11265-21ssh00:26:503
1736499140,10cyclictest7856-21sh21:25:453
1736499140,10cyclictest780-21runrttasks00:18:303
1736499140,10cyclictest7752-21mailstats19:55:193
1736499140,10cyclictest7075-21ssh22:01:053
1736499140,10cyclictest5707-21ssh23:11:593
1736499140,10cyclictest4626-21ssh23:47:163
1736499140,10cyclictest419-21ssh23:09:403
1736499140,10cyclictest31701-21sh21:21:113
1736499140,10cyclictest28574-21ssh22:13:293
1736499140,10cyclictest27545-21sh22:48:473
1736499140,10cyclictest26799-21runrttasks19:29:553
1736499140,10cyclictest25195-21/usr/sbin/munin00:35:193
1736499140,10cyclictest22178-21ssh23:56:453
1736499140,10cyclictest21846-21chrt19:17:323
1736499140,10cyclictest2022-21ssh21:40:253
1736499140,10cyclictest19525-21ssh21:32:363
1736499140,10cyclictest19525-21ssh21:32:353
1736499140,10cyclictest1796-21ssh22:52:073
1736499140,10cyclictest17497-21sh21:13:583
1736499140,10cyclictest17103-21ssh23:35:503
1736499140,10cyclictest16561-21tr20:15:143
1736499140,10cyclictest16371-21sh22:06:153
1736499140,10cyclictest16242-21ssh00:30:103
1736499140,10cyclictest1198-21ssh00:20:573
1736499140,10cyclictest11826-21/usr/sbin/munin22:40:213
1736499140,10cyclictest11333-21sh22:21:233
1736099147,6cyclictest2561-21sed19:45:172
1736099143,8cyclictest10192-21basename21:45:172
1736099141,9cyclictest7418-21/usr/sbin/munin00:25:192
1736099141,9cyclictest6644-21sh22:55:042
1736099141,9cyclictest28461-21sh21:20:032
1736099141,9cyclictest23209-21sh22:45:422
1736099141,9cyclictest16573-21taskset23:18:182
1736099141,10cyclictest16-1pr/legacy21:58:372
1736099141,10cyclictest11026-21runrttasks23:50:252
1736099140,9cyclictest25033-21taskset20:30:332
1736099140,11cyclictest17441-21sed23:00:232
1736099140,10cyclictest8341-21rm22:37:572
1736099140,10cyclictest6768-21ssh23:30:172
1736099140,10cyclictest6768-21ssh23:30:172
1736099140,10cyclictest4897-21sh22:54:172
1736099140,10cyclictest4625-21sh23:29:462
1736099140,10cyclictest4625-21sh23:29:462
1736099140,10cyclictest31048-21ssh00:20:122
1736099140,10cyclictest3045-21/usr/sbin/munin20:55:122
1736099140,10cyclictest26639-21runrttasks19:27:442
1736099140,10cyclictest25266-21rm23:22:512
1736099140,10cyclictest2486-21ssh21:40:372
1736099140,10cyclictest24427-21chrt19:24:392
1736099140,10cyclictest23594-21/usr/sbin/munin23:40:202
1736099140,10cyclictest21815-21/usr/sbin/munin00:15:192
1736099140,10cyclictest21287-21ssh23:38:492
1736099140,10cyclictest18365-21cat19:10:152
1736099140,10cyclictest17560-21runrttasks21:14:002
1736099140,10cyclictest16828-21chrt22:06:332
1736099140,10cyclictest16048-21ssh00:30:022
1736099140,10cyclictest15024-21ssh00:10:302
1736099140,10cyclictest11395-21sh22:04:062
1736099140,10cyclictest11164-21rm00:09:092
1735999143,8cyclictest755-21postgres23:57:231
1735999143,8cyclictest716-21snmpd19:28:081
1735999141,9cyclictest9412-21ssh00:07:541
1735999141,9cyclictest8943-21proc_pri21:05:181
1735999141,9cyclictest29240-21runrttasks22:49:571
1735999141,10cyclictest4587-21/usr/sbin/munin22:35:241
1735999141,10cyclictest21519-21runrttasks22:27:111
1735999140,9cyclictest686-21tune2fs21:40:161
1735999140,9cyclictest31103-21ssh22:15:001
1735999140,9cyclictest25055-21ssh00:35:051
1735999140,9cyclictest20877-21ssh22:09:231
1735999140,10cyclictest9506-21chrt21:26:551
1735999140,10cyclictest780-21runrttasks23:26:301
1735999140,10cyclictest780-21runrttasks23:26:291
1735999140,10cyclictest780-21runrttasks22:55:531
1735999140,10cyclictest6389-21date22:55:001
1735999140,10cyclictest5059-21ssh23:11:301
1735999140,10cyclictest32087-21ssh21:21:271
1735999140,10cyclictest30547-21ssh23:08:031
1735999140,10cyclictest30486-21ssh22:32:081
1735999140,10cyclictest29638-21ssh21:38:201
1735999140,10cyclictest29638-21ssh21:38:191
1735999140,10cyclictest26162-21sh21:54:281
1735999140,10cyclictest2592-21sh00:21:561
1735999140,10cyclictest25476-21sh21:18:101
1735999140,10cyclictest21477-21grep20:25:151
1735999140,10cyclictest21193-21sendmail_mailtr19:15:201
1735999140,10cyclictest20515-21cat22:45:001
1735999140,10cyclictest18584-21rm00:13:061
1735999140,10cyclictest16738-21sh23:54:291
1735999140,10cyclictest16698-21ssh23:18:241
1735999140,10cyclictest14666-21interrupts20:10:171
1735999140,10cyclictest14510-21/usr/sbin/munin21:30:201
1735999140,10cyclictest14510-21/usr/sbin/munin21:30:191
1735999140,10cyclictest14350-21sleep23:35:031
1735999140,10cyclictest11180-21ssh00:26:461
1735999140,10cyclictest10404-21/usr/sbin/munin21:10:191
1735899146,6cyclictest17549-21/usr/sbin/munin20:15:240
1735899145,7cyclictest26996-21ssh22:30:170
1735899142,5cyclictest21451-21cut22:45:180
1735899141,10cyclictest780-21runrttasks23:27:490
1735899141,10cyclictest780-21runrttasks23:27:480
1735899141,10cyclictest16-1pr/legacy19:46:470
1735899140,8cyclictest4533-21sh21:42:010
1735899140,7cyclictest5524-21apt-get23:30:110
1735899140,7cyclictest5524-21apt-get23:30:100
1735899140,7cyclictest25030-21python321:35:200
1735899140,7cyclictest25030-21python321:35:200
1735899140,5cyclictest7498-21cut22:55:140
1735899140,12cyclictest991-21ssh22:51:320
1735899140,11cyclictest780-21runrttasks23:54:010
1735899140,10cyclictest780-21runrttasks21:21:290
1735899140,10cyclictest4790-21ssh22:35:270
1735899140,10cyclictest22972-21ssh23:21:130
1735899140,10cyclictest22196-21taskset22:27:400
1735899140,10cyclictest19313-21sh21:32:260
1735899140,10cyclictest19313-21sh21:32:260
1735899140,10cyclictest12832-21grep22:40:170
2888399130,11tDemoTimingTask311742sleep519:36:035
1736999131,9cyclictest9793-21taskset20:00:174
1736999131,9cyclictest28678-21diskmemload21:55:184
1736999131,9cyclictest26081-21ssh23:40:484
1736999131,7cyclictest27608-21cpuspeed_turbos00:00:124
1736999130,9cyclictest979-21sh00:20:484
1736999130,9cyclictest8595-21diskmemload22:02:094
1736999130,9cyclictest8261-21sh22:55:194
1736999130,9cyclictest7987-21ssh22:20:094
1736999130,9cyclictest7985-21/usr/sbin/munin21:05:114
1736999130,9cyclictest780-21runrttasks21:30:124
1736999130,9cyclictest780-21runrttasks21:30:114
1736999130,9cyclictest780-21runrttasks20:50:154
1736999130,9cyclictest780-21runrttasks20:28:444
1736999130,9cyclictest780-21runrttasks19:53:204
1736999130,9cyclictest780-21runrttasks19:20:194
1736999130,9cyclictest5104-21runrttasks20:59:304
1736999130,9cyclictest3842-21latency_hist19:50:004
1736999130,9cyclictest31846-21/usr/sbin/munin19:40:164
1736999130,9cyclictest31368-21/usr/sbin/munin22:15:244
1736999130,9cyclictest31245-21sh21:20:514
1736999130,9cyclictest30263-21latency19:35:164
1736999130,9cyclictest28090-21/usr/sbin/munin20:40:114
1736999130,9cyclictest27114-21/usr/sbin/munin19:30:164
1736999130,9cyclictest25721-21/usr/sbin/munin20:35:194
1736999130,9cyclictest25497-21sh22:11:184
1736999130,9cyclictest25034-21ssh00:35:034
1736999130,9cyclictest23146-21cut00:15:204
1736999130,9cyclictest19915-21/usr/sbin/munin23:20:164
1736999130,9cyclictest19215-21fschecks_time20:20:134
1736999130,9cyclictest18013-21runrttasks20:16:234
1736999130,9cyclictest16898-21runrttasks22:25:034
1736999130,9cyclictest16245-21/usr/sbin/munin00:30:134
1736999130,9cyclictest14500-21runrttasks20:10:144
1736999130,9cyclictest13027-21timerwakeupswit20:05:234
1736999130,9cyclictest10367-21sh21:10:084
1736999130,9cyclictest10314-21sh23:15:014
1736999130,10cyclictest2778-21sh21:40:514
1736999130,10cyclictest25745-21irqstats23:05:154
1736999130,10cyclictest19365-21rm23:01:314
1736999130,10cyclictest17625-21/usr/sbin/munin19:10:164
1736999130,10cyclictest15912-21ssh22:05:554
1736499130,9cyclictest780-21runrttasks20:56:453
1736499130,9cyclictest780-21runrttasks19:50:083
1736499130,9cyclictest5470-21/usr/sbin/munin21:00:193
1736499130,9cyclictest5408-21sh23:30:063
1736499130,9cyclictest5408-21sh23:30:053
1736499130,9cyclictest30450-21/usr/sbin/munin20:45:133
1736499130,9cyclictest29828-21df_inode19:35:123
1736499130,9cyclictest28090-21/usr/sbin/munin20:40:183
1736499130,9cyclictest28014-21grep21:55:143
1736499130,9cyclictest27211-21aten2_r5power_v19:30:123
1736499130,9cyclictest25721-21/usr/sbin/munin20:35:143
1736499130,9cyclictest22661-21users20:25:253
1736499130,9cyclictest19561-21apt-get21:15:113
1736499130,9cyclictest19178-21fschecks_time20:20:133
1736499130,9cyclictest1845-21aten2_r5power_e19:45:133
1736499130,9cyclictest17625-21/usr/sbin/munin19:10:193
1736499130,9cyclictest15872-21taskset20:13:423
1736499130,9cyclictest12750-21sh00:10:033
1736499130,10cyclictest8025-21ls21:05:113
1736099135,6cyclictest32503-21ls20:50:002
1736099135,4cyclictest9790-21/usr/sbin/munin20:00:172
1736099134,6cyclictest18994-21cstates20:20:112
1736099131,8cyclictest7885-21grep21:05:112
1736099130,9cyclictest975-21grep20:50:132
1736099130,9cyclictest780-21runrttasks00:00:422
1736099130,9cyclictest7138-21gltestperf19:55:142
1736099130,9cyclictest4158-21aten2_r5power_c19:50:112
1736099130,9cyclictest29410-21grep19:35:002
1736099130,9cyclictest25195-21/usr/sbin/munin00:35:142
1736099130,9cyclictest19972-21runrttasks19:15:062
1736099130,9cyclictest17349-21cpuspeed_turbos22:25:132
1736099130,9cyclictest16417-21cpu20:15:132
1736099130,10cyclictest30686-21awk19:35:192
1736099130,10cyclictest26194-21aten2_r5power_e22:30:132
1736099130,10cyclictest21282-21tr20:25:132
1736099130,10cyclictest15892-21taskset20:13:592
1736099130,10cyclictest11571-21/usr/sbin/munin20:05:242
1736099130,10cyclictest10637-21ssh22:20:532
1735999131,7cyclictest18872-21grep20:20:121
1735999130,9cyclictest8918-21/usr/sbin/munin20:00:201
1735999130,9cyclictest780-21runrttasks20:35:201
1735999130,9cyclictest780-21runrttasks19:50:511
1735999130,9cyclictest6546-21/usr/sbin/munin19:55:121
1735999130,9cyclictest5516-21/usr/sbin/munin23:30:181
1735999130,9cyclictest5516-21/usr/sbin/munin23:30:171
1735999130,9cyclictest326-21systemd-journal19:44:091
1735999130,9cyclictest32190-21sh23:45:021
1735999130,9cyclictest3045-21/usr/sbin/munin20:55:191
1735999130,9cyclictest30450-21/usr/sbin/munin20:45:191
1735999130,9cyclictest30391-21wc19:35:171
1735999130,9cyclictest23726-21ssh23:40:131
1735999130,9cyclictest23534-21cpu20:30:141
1735999130,9cyclictest22501-21aten2_r5power_p19:20:121
1735999130,9cyclictest2125-21cstates19:45:141
1735999130,9cyclictest16633-21runrttasks20:15:141
1735999130,9cyclictest11571-21/usr/sbin/munin20:05:121
1735999130,10cyclictest7173-21runrttasks21:01:031
1735999130,10cyclictest6077-21sed22:00:241
1735999130,10cyclictest22523-21chrt23:20:541
1735999130,10cyclictest21815-21/usr/sbin/munin00:15:141
1735999130,10cyclictest15684-21ssh23:00:041
1735899135,7cyclictest31549-21/usr/sbin/munin20:45:200
1735899131,2cyclictest3048-21apt-get20:55:120
1735899130,9cyclictest780-21runrttasks21:07:430
1735899130,9cyclictest780-21runrttasks19:42:570
1735899130,9cyclictest21704-21sh00:15:080
1735899130,9cyclictest18001-21forks19:10:130
1735899130,9cyclictest1087-21grep20:50:130
1735899130,7cyclictest174-1kworker/0:1H+kblockd20:30:130
1735899130,7cyclictest174-1kworker/0:1H+kblockd20:10:020
1735899130,7cyclictest174-1kworker/0:1H+kblockd19:50:280
1735899130,11cyclictest12447-21/usr/sbin/munin20:05:170
1735899130,10cyclictest6733-21/usr/sbin/munin21:00:220
1735899130,10cyclictest27617-21runrttasks20:38:020
1735899130,10cyclictest25626-21sed19:25:170
1735899130,10cyclictest24644-21sh23:05:010
1071499132,9tDemoTimingTask10814-21chrt20:03:005
92499120,10tDemoTimingTask9405-21taskset22:38:435
92499120,10tDemoTimingTask1907-21chrt22:34:495
588099120,10tDemoTimingTask9444-21taskset00:07:545
483299120,10tDemoTimingTask13256-21chrt23:34:325
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional