You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-26 - 17:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Fri Jun 26, 2026 12:44:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
279352910,1sleep50-21swapper/510:21:395
601139840,0EcMasterDemoSyn602129tAtEmLog_011:57:285
1914539830,0EcMasterDemoSyn1915529tAtEmLog_008:54:545
385039820,0EcMasterDemoSyn386029tAtEmLog_010:26:115
2337539820,0EcMasterDemoSyn2338529tAtEmLog_009:25:205
1639439820,1EcMasterDemoSyn16399-21runintdemo5min11:27:033
938639810,0EcMasterDemoSyn939629tAtEmLog_008:34:375
466339810,0EcMasterDemoSyn467329tAtEmLog_008:24:285
382839810,0EcMasterDemoSyn383829tAtEmLog_009:15:125
1174239810,0EcMasterDemoSyn1175229tAtEmLog_008:39:415
183242610,0sleep30-21swapper/307:45:003
470339500,0EcMasterDemoSyn0-21swapper/309:50:413
3232339360,0EcMasterDemoSyn0-21swapper/208:14:212
2282139280,0EcMasterDemoSyn0-21swapper/507:54:035
1001799190,12tDemoTimingTask159362sleep512:20:355
95599180,9cyclictest9649-21mailstats12:35:200
95599180,14cyclictest24648-21sh12:07:540
1797099180,8tDemoTimingTask19948-21chrt10:17:265
1554839180,0EcMasterDemoSyn0-21swapper/507:38:505
1129139180,0EcMasterDemoSyn0-21swapper/511:42:155
962991713,3cyclictest693-21in:imuxsock11:00:004
96299170,9cyclictest9168-21sh09:17:484
961991714,2cyclictest9425-21needreboot12:35:173
95599175,9cyclictest29789-21sh09:46:530
95599175,9cyclictest25328-21ssh10:56:010
95599171,9cyclictest2961-21sh10:08:110
95599170,9cyclictest29936-21sh11:35:000
95599170,9cyclictest21578-21sh10:35:570
92599170,10tDemoTimingTask1060-21chrt12:12:445
471329170,10tAtEmLog_010711-21taskset09:54:565
3129999170,7tDemoTimingTask32060-21chrt10:41:555
295099170,8tDemoTimingTask3245-21taskset11:01:535
1705699170,15tDemoTimingTask17637-21taskset10:51:575
1444099170,10tDemoTimingTask14479-21chrt08:44:555
1300599170,10tDemoTimingTask18591-21taskset10:35:015
1001799170,7tDemoTimingTask10467-21chrt12:18:045
96299168,6cyclictest7732-21apt12:35:004
96199168,6cyclictest11658-21grep10:30:233
961991613,2cyclictest21566-21idleruntime-cro09:00:003
96199161,11cyclictest16-1pr/legacy12:12:403
96199160,10cyclictest10284-21runrttasks12:00:123
96099160,8cyclictest21693-21diskmemload11:48:152
95999160,13cyclictest21863-21sh10:18:481
95599168,6cyclictest25231-21tail11:50:130
95599164,9cyclictest24204-21sed12:12:400
95599161,6cyclictest25627-21latency_hist11:15:000
955991613,2cyclictest5641-21idleruntime-cro07:20:000
95599160,9cyclictest780-21runrttasks08:07:460
95599160,8cyclictest1508-21tr07:10:240
95599160,13cyclictest780-21runrttasks09:03:530
95599160,11cyclictest27222-21ssh11:15:150
482639160,13EcMasterDemoSyn5621-21chrt12:33:315
383999160,6tDemoTimingTask13448-21taskset09:20:145
295099160,7tDemoTimingTask9704-21taskset11:05:245
1705699160,7tDemoTimingTask24965-21taskset10:55:455
96299157,6cyclictest29652-21grep08:05:274
96299155,8cyclictest1899-21/usr/sbin/munin11:55:134
96299154,8cyclictest14577-21cat09:20:224
96299154,6cyclictest8494-21seq12:16:414
962991511,3cyclictest19595-21gltestperf10:35:154
96299150,9cyclictest780-21runrttasks07:53:564
96299150,13cyclictest9324-21sed12:35:164
96299150,10cyclictest13208-21date10:50:004
96199158,5cyclictest26311-21tr09:45:143
96199155,8cyclictest18121-21/usr/sbin/munin09:40:223
96199153,9cyclictest13273-21unixbench_multi09:55:253
96199151,11cyclictest16-1pr/legacy12:22:483
96199151,10cyclictest9700-21diskmemload09:18:103
96199151,10cyclictest29744-21sh10:22:563
96199150,9cyclictest11356-21sh11:42:173
96199150,11cyclictest501-21sh11:36:013
96199150,11cyclictest18676-21sh11:10:233
96199150,10cyclictest26869-21ssh11:50:393
96099156,7cyclictest1825-21apt09:50:002
96099155,9cyclictest18246-21/usr/sbin/munin08:50:202
96099154,8cyclictest24552-21grep12:25:242
96099154,8cyclictest21476-21grep10:00:192
960991511,3cyclictest16691-21latency_hist12:40:002
960991511,3cyclictest15678-21savelog07:40:002
96099151,11cyclictest16-1pr/legacy09:05:012
96099151,10cyclictest716-21snmpd09:51:412
96099151,10cyclictest24008-21sshd10:55:222
96099151,10cyclictest18724-21runrttasks12:22:342
96099150,10cyclictest4960-21ssh10:26:562
96099150,10cyclictest28477-21sh11:51:462
95999151,10cyclictest32566-21runrttasks09:48:501
95999151,10cyclictest17252-21aten2_r5power_v08:50:121
95999151,10cyclictest11959-21ssh09:19:471
95999151,10cyclictest10371-21ssh09:36:001
95999151,10cyclictest10371-21ssh09:35:591
95999150,9cyclictest23625-21diskmemload11:49:421
95999150,9cyclictest1718-21diskmemload12:30:441
95999150,10cyclictest30938-21ssh09:30:081
95599158,5cyclictest15592-21grep08:45:170
95599156,7cyclictest7316-21sshd11:58:230
955991511,3cyclictest20505-21needreboot08:55:180
95599150,9cyclictest26229-21diskmemload12:25:010
95599150,9cyclictest10745-21ssh10:12:180
95599150,6cyclictest8735-21ntp_offset09:35:170
95599150,6cyclictest8735-21ntp_offset09:35:160
95599150,11cyclictest28030-21sh11:33:530
95599150,11cyclictest28030-21sh11:33:520
73899150,9tDemoTimingTask1029-21taskset07:10:005
3129999150,6tDemoTimingTask6992-21taskset10:45:505
96299143,8cyclictest27350-21cpuspeed09:10:124
96299141,9cyclictest28367-21unixbench_multi11:15:244
96299141,10cyclictest10939-21sh10:12:264
96299140,9cyclictest7401-21/usr/sbin/munin08:30:124
96299140,9cyclictest5967-21ssh10:45:234
96299140,9cyclictest3648-21aten2_r5power_e07:15:164
96299140,9cyclictest2269-21ssh12:13:364
96299140,9cyclictest10343-21ssh11:41:354
96299140,8cyclictest17233-21sh11:45:204
96299140,12cyclictest16045-21/usr/sbin/munin07:40:204
96299140,12cyclictest13402-21ssh09:55:284
96299140,10cyclictest4986-21ssh09:33:304
96299140,10cyclictest29796-21ssh10:22:584
96299140,10cyclictest24737-21sh11:14:234
96299140,10cyclictest23271-21ssh11:30:334
96299140,10cyclictest23271-21ssh11:30:334
96299140,10cyclictest2146-21sh10:07:374
96299140,10cyclictest15795-21sh12:20:284
96299140,10cyclictest10451-21sh11:24:114
96199146,6cyclictest23151-21ntpq09:25:193
96199146,6cyclictest14000-21fschecks_time10:50:143
96199144,8cyclictest19578-21tail10:35:153
96199141,10cyclictest5872-21latency08:25:173
96199141,10cyclictest2877-21/usr/sbin/munin07:10:373
96199141,10cyclictest15745-21mv07:40:003
96199141,10cyclictest13295-21runrttasks07:34:443
96199141,10cyclictest10235-21sh10:11:563
96199140,9cyclictest9607-21grep07:25:173
96199140,8cyclictest21068-21cpuspeed07:50:113
96199140,12cyclictest1277-21ssh12:30:263
96199140,11cyclictest21882-21ssh10:00:233
96199140,10cyclictest8184-21/usr/sbin/munin11:05:123
96199140,10cyclictest780-21runrttasks12:06:413
96199140,10cyclictest780-21runrttasks09:00:203
96199140,10cyclictest780-21runrttasks08:04:323
96199140,10cyclictest7510-21diskmemload09:35:093
96199140,10cyclictest7510-21diskmemload09:35:093
96199140,10cyclictest5893-21ssh11:20:573
96199140,10cyclictest4829-21/usr/sbin/munin12:15:123
96199140,10cyclictest4817-21grep07:15:243
96199140,10cyclictest464-21ssh10:06:283
96199140,10cyclictest4480-21/usr/sbin/munin10:45:183
96199140,10cyclictest4293-21sh11:02:373
96199140,10cyclictest4011-21wc08:20:233
96199140,10cyclictest3501-21sh10:25:573
96199140,10cyclictest30848-21sh11:17:043
96199140,10cyclictest30848-21sh09:30:053
96199140,10cyclictest30581-21rm09:11:273
96199140,10cyclictest29866-21chrt08:08:043
96199140,10cyclictest2410-21ntp_offset11:55:173
96199140,10cyclictest23761-21ssh11:30:543
96199140,10cyclictest23761-21ssh11:30:543
96199140,10cyclictest22469-21sh12:25:023
96199140,10cyclictest2234-21chrt08:18:543
96199140,10cyclictest21202-21sh11:47:533
96199140,10cyclictest18146-21uname08:50:173
96199140,10cyclictest14978-21ssh10:15:063
96199140,10cyclictest14068-21ssh09:20:173
96199140,10cyclictest1371-21ssh10:43:083
96099146,6cyclictest326-21systemd-journal07:20:012
96099144,8cyclictest10110-21/usr/sbin/munin08:35:132
96099141,9cyclictest28008-21sh12:10:052
96099141,9cyclictest21412-21runrttasks08:58:552
96099141,9cyclictest15398-21ssh09:56:502
96099141,9cyclictest10946-21sh11:06:002
96099140,8cyclictest5077-21cut10:45:162
96099140,11cyclictest18964-21rm12:05:022
96099140,10cyclictest9423-21sh11:40:552
96099140,10cyclictest7918-21diskstats09:35:112
96099140,10cyclictest7918-21diskstats09:35:112
96099140,10cyclictest780-21runrttasks08:49:172
96099140,10cyclictest780-21runrttasks08:29:352
96099140,10cyclictest7401-21/usr/sbin/munin08:30:172
96099140,10cyclictest716-21snmpd07:55:252
96099140,10cyclictest6073-21/usr/sbin/munin10:10:162
96099140,10cyclictest5372-21sh12:33:192
96099140,10cyclictest4954-21cpu12:15:112
96099140,10cyclictest4614-21taskset08:23:582
96099140,10cyclictest31594-21/usr/sbin/munin11:00:192
96099140,10cyclictest31307-21needreboot11:35:172
96099140,10cyclictest30939-21sh09:30:092
96099140,10cyclictest30514-21ssh10:40:512
96099140,10cyclictest29643-21/usr/sbin/munin10:05:122
96099140,10cyclictest2962-21ssh11:20:012
96099140,10cyclictest28658-21gltestperf08:05:162
96099140,10cyclictest27123-21/usr/sbin/munin09:10:122
96099140,10cyclictest27022-21ssh11:15:142
96099140,10cyclictest25612-21/usr/sbin/munin08:00:102
96099140,10cyclictest25113-21sh11:31:532
96099140,10cyclictest25113-21sh11:31:522
96099140,10cyclictest24126-21/usr/sbin/munin10:20:122
96099140,10cyclictest21903-21/usr/sbin/munin09:25:192
96099140,10cyclictest21872-21/usr/sbin/munin09:00:122
96099140,10cyclictest20200-21chrt07:45:292
96099140,10cyclictest18641-21rm10:35:022
96099140,10cyclictest17654-21sh10:15:502
96099140,10cyclictest17071-21ssh11:10:072
96099140,10cyclictest17031-21diskstats09:40:132
96099140,10cyclictest13883-21diskstats10:50:132
96099140,10cyclictest13768-21ssh12:01:362
96099140,10cyclictest13315-21memory08:40:172
96099140,10cyclictest12723-21ssh09:20:052
96099140,10cyclictest12656-21ssh10:31:032
96099140,10cyclictest11971-21ssh11:25:042
96099140,10cyclictest1163-21/usr/sbin/munin11:55:122
96099140,10cyclictest10400-21runrttasks07:27:142
96099140,10cyclictest10221-21runrttasks09:18:342
95999143,8cyclictest12807-21entropy08:40:141
95999141,9cyclictest20818-21ssh11:11:381
95999141,9cyclictest16032-21runrttasks07:40:011
95999140,9cyclictest4500-21latency_hist12:15:011
95999140,11cyclictest21547-21ssh12:05:431
95999140,10cyclictest8610-21/usr/sbin/munin07:25:211
95999140,10cyclictest780-21runrttasks12:26:541
95999140,10cyclictest774-21/usr/sbin/munin10:25:221
95999140,10cyclictest756-21postgres07:45:151
95999140,10cyclictest7400-21taskset08:30:101
95999140,10cyclictest6498-21sh10:10:131
95999140,10cyclictest6257-21/usr/sbin/munin07:20:171
95999140,10cyclictest5785-21sh09:51:271
95999140,10cyclictest5347-21taskset07:16:581
95999140,10cyclictest4567-21sh12:15:021
95999140,10cyclictest3603-21diskstats11:20:141
95999140,10cyclictest3327-21gltestperf08:20:141
95999140,10cyclictest32720-21/usr/sbin/munin08:15:221
95999140,10cyclictest32514-21ssh10:42:141
95999140,10cyclictest31615-21sh11:00:111
95999140,10cyclictest30370-21/usr/sbin/munin08:10:261
95999140,10cyclictest29876-21sh09:10:571
95999140,10cyclictest29322-21ssh10:05:041
95999140,10cyclictest29226-21grep08:05:221
95999140,10cyclictest29215-21runrttasks11:15:561
95999140,10cyclictest28671-21sh10:22:101
95999140,10cyclictest27578-21runrttasks08:03:541
95999140,10cyclictest26146-21chrt09:09:011
95999140,10cyclictest25588-21cat11:50:161
95999140,10cyclictest24351-21runrttasks09:25:431
95999140,10cyclictest23273-21ssh10:01:041
95999140,10cyclictest23230-21threads09:00:241
95999140,10cyclictest23014-21ssh09:43:311
95999140,10cyclictest22317-21sh10:55:031
95999140,10cyclictest21422-21ssh10:35:511
95999140,10cyclictest21179-21runrttasks08:55:431
95999140,10cyclictest20940-21ssh11:30:041
95999140,10cyclictest20940-21ssh11:30:031
95999140,10cyclictest18681-21rm12:22:331
95999140,10cyclictest16055-21ssh10:50:521
95999140,10cyclictest14920-21sh11:25:591
95999140,10cyclictest13706-21awk09:20:151
95999140,10cyclictest1258-21basename07:10:231
95999140,10cyclictest12360-21ssh12:36:561
95999140,10cyclictest1193-21aten2_r5power_c11:55:111
95999140,10cyclictest11911-21fschecks_count09:55:151
95999140,10cyclictest11243-21ssh11:06:141
95999140,10cyclictest10913-21ssh12:00:141
95999140,10cyclictest10207-21ssh11:41:291
95599146,6cyclictest4401-21ssh11:02:410
95599145,7cyclictest9912-21sh11:05:270
95599145,7cyclictest811-21runintdemo5min09:25:210
95599145,7cyclictest15157-21ssh09:20:370
95599143,8cyclictest22431-21unixbench_multi07:50:230
95599143,8cyclictest18017-21load08:50:170
95599142,9cyclictest3931-21which11:20:160
95599141,9cyclictest918-21rm10:25:110
95599141,11cyclictest16086-21sh11:26:490
95599141,10cyclictest9462-21latency_hist08:35:000
95599141,10cyclictest11419-21diskmemload10:30:220
955991410,3cyclictest0-21swapper/008:25:010
95599140,8cyclictest16913-21unixbench_multi10:15:240
95599140,8cyclictest10086-21diskmemload11:41:250
95599140,7cyclictest2561-21rm12:31:210
95599140,7cyclictest15119-21ssh09:56:380
95599140,12cyclictest956-21ssh09:13:250
95599140,12cyclictest6450-21ssh09:15:530
95599140,12cyclictest28701-21/usr/sbin/munin10:40:160
95599140,12cyclictest25225-21sh10:02:270
95599140,12cyclictest14586-21grep10:50:170
95599140,10cyclictest4688-21rm12:15:070
95599140,10cyclictest26060-21users10:20:230
95599140,10cyclictest23780-21sh09:44:030
95599140,10cyclictest2242-21sh09:50:060
95599140,10cyclictest1895-21ssh09:31:190
95599140,10cyclictest18080-21sh12:22:070
95599140,10cyclictest17261-21sh11:45:210
95599140,10cyclictest15823-21ssh12:03:010
95599140,10cyclictest10241-21ssh10:48:050
386199140,12tDemoTimingTask12280-21taskset10:30:465
2548299140,8tDemoTimingTask20605-21sleep11:34:555
2548299140,8tDemoTimingTask20605-21sleep11:34:555
96299136,5cyclictest2698-21/usr/sbin/munin08:20:104
96299135,6cyclictest648-21dbus-daemon07:30:024
96299134,7cyclictest25830-21/usr/sbin/munin08:00:134
96299133,5cyclictest1573-21python308:15:214
96299131,9cyclictest780-21runrttasks09:40:534
96299131,9cyclictest716-21snmpd08:57:124
96299131,9cyclictest6811-21perl07:20:154
96299131,9cyclictest26168-21runrttasks09:09:204
96299131,8cyclictest5410-21sh09:51:104
96299131,7cyclictest1684950latency_hist08:50:004
96299130,9cyclictest9761-21/usr/sbin/munin08:35:234
96299130,9cyclictest780-21runrttasks11:51:084
96299130,9cyclictest780-21runrttasks09:45:294
96299130,9cyclictest780-21runrttasks07:27:554
96299130,9cyclictest7409-21ssh10:28:414
96299130,9cyclictest5037-21taskset08:25:034
96299130,9cyclictest3200-21sh11:01:514
96299130,9cyclictest31237-21taskset08:10:184
96299130,9cyclictest30175-21/usr/sbin/munin11:35:244
96299130,9cyclictest24880-21sh12:25:354
96299130,9cyclictest22224-21/usr/sbin/munin09:00:124
96299130,9cyclictest21651-21sh09:25:014
96299130,9cyclictest20636-21sh10:00:134
96299130,9cyclictest19063-21sh12:05:064
96299130,9cyclictest18793-21runrttasks08:50:254
96299130,9cyclictest15079-21/usr/sbin/munin10:15:114
96299130,9cyclictest13921-21ssh10:31:534
96299130,9cyclictest13625-21/usr/sbin/munin07:35:224
96299130,9cyclictest12587-21ssh11:25:144
96299130,9cyclictest1242-21/usr/sbin/munin07:10:304
96299130,8cyclictest19662-21processes07:45:204
96299130,10cyclictest8377-21irqstats09:35:144
96299130,10cyclictest8377-21irqstats09:35:144
96299130,10cyclictest28854-21cat10:40:164
96299130,10cyclictest15996-21ssh11:09:334
96299130,10cyclictest10177-21/usr/sbin/munin12:00:124
96199135,6cyclictest8255-21cat08:30:173
96199135,6cyclictest15185-21fschecks_count08:45:153
96199130,9cyclictest780-21runrttasks10:55:073
96199130,9cyclictest32097-21runrttasks08:11:233
96199130,9cyclictest24360-21cpu09:05:123
96199130,9cyclictest23494-21cpuspeed_turbos07:55:143
96199130,9cyclictest10448-21idleruntime08:35:153
96199130,10cyclictest7299-21ntp_kernel_err07:20:183
96199130,10cyclictest18638-21aten2_r5power_v07:45:143
96199130,10cyclictest14098-21vmstat08:40:253
96099130,9cyclictest4629-21ntpq07:15:222
96099130,9cyclictest22789-21runrttasks07:53:462
96099130,10cyclictest780-21runrttasks08:15:152
96099130,10cyclictest1232-21chrt07:10:152
95999135,6cyclictest30467-21grep11:35:121
95999131,9cyclictest9758-21runrttasks08:35:091
95999130,9cyclictest9691-21sh10:30:061
95999130,9cyclictest6480-21sh10:45:281
95999130,9cyclictest5048-21/usr/sbin/munin08:25:141
95999130,9cyclictest23242-21/usr/sbin/munin07:55:191
95999130,9cyclictest20993-21aten2_r5power_v07:50:111
95999130,9cyclictest14790-21runrttasks08:45:071
95999130,9cyclictest13617-21runrttasks07:35:051
95999130,9cyclictest12121-21latency07:30:181
95999130,9cyclictest1060-21grep07:10:001
95599135,7cyclictest19720-21/usr/sbin/munin07:45:200
95599135,6cyclictest14291-21/usr/sbin/munin07:35:140
95599131,9cyclictest16521-21fschecks_time07:40:140
95599130,9cyclictest780-21runrttasks08:19:200
95599130,9cyclictest780-21runrttasks07:55:020
95599130,9cyclictest6093-21ntp_kernel_err08:25:190
95599130,9cyclictest14276-21taskset08:42:500
95599130,9cyclictest10435-21chrt07:27:410
95599130,7cyclictest174-1kworker/0:1H+kblockd07:22:090
95599130,11cyclictest648-21dbus-daemon07:30:020
95599130,11cyclictest25575-21sshd09:05:220
95599130,10cyclictest780-21runrttasks08:38:090
95599130,10cyclictest780-21runrttasks08:13:060
731339130,0EcMasterDemoSyn0-21swapper/511:21:585
5489991312,0tDemoTimingTask0-21swapper/507:20:005
2151299130,11tDemoTimingTask23812-21chrt09:04:175
963099121,10tDemoTimingTask0-21swapper/509:35:325
963099121,10tDemoTimingTask0-21swapper/509:35:325
96299120,9cyclictest22934-21cron07:55:014
96299120,9cyclictest12761-21cpuspeed_turbos08:40:144
96199120,9cyclictest1179-21latency_hist07:10:003
96099120,9cyclictest17903-21runrttasks07:41:212
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional