You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-10 - 18:23
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Wed Dec 10, 2025 12:44:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
983391270,0EcMasterDemoSyn0-21swapper/009:48:470
41372960,0sleep20-21swapper/211:45:202
2112839950,0EcMasterDemoSyn2113929tAtEmLog_012:26:005
3082139910,0EcMasterDemoSyn3083129tAtEmLog_011:40:205
960139830,0EcMasterDemoSyn961129tAtEmLog_008:42:515
493139830,0EcMasterDemoSyn494129tAtEmLog_011:20:035
3012139830,1EcMasterDemoSyn3013129tAtEmLog_008:17:305
2989639830,0EcMasterDemoSyn2990629tAtEmLog_010:14:085
455239820,0EcMasterDemoSyn455929tAtEmLog_011:45:265
1905539820,0EcMasterDemoSyn1906529tAtEmLog_009:03:095
1071739820,0EcMasterDemoSyn1072729tAtEmLog_007:36:565
1071739820,0EcMasterDemoSyn1072729tAtEmLog_007:36:565
722139810,0EcMasterDemoSyn723129tAtEmLog_008:37:485
3095939810,0EcMasterDemoSyn3096929tAtEmLog_011:14:595
3093939810,0EcMasterDemoSyn3094929tAtEmLog_009:18:225
2888439810,0EcMasterDemoSyn2889429tAtEmLog_007:06:315
2274039810,0EcMasterDemoSyn2275029tAtEmLog_008:02:175
1195739810,0EcMasterDemoSyn1196829tAtEmLog_008:47:565
29250993428,5cyclictest5896-21kworker/2:2+events08:52:582
1405139300,1EcMasterDemoSyn14056-21runintdemo5min10:59:464
1405139300,1EcMasterDemoSyn14056-21runintdemo5min10:59:464
29259992219,2cyclictest11964-21kworker/4:0+events07:47:034
287299200,8tDemoTimingTask2876-21taskset12:10:475
2924199194,8cyclictest15251-21sh12:21:290
3012139180,0EcMasterDemoSyn30129-21runintdemo5min08:17:304
2925599180,9cyclictest10799-21fschecks_time10:25:143
2925099181,13cyclictest16-1pr/legacy07:26:462
2924199183,13cyclictest1313-21sh11:43:200
2924199180,14cyclictest6584-21sh09:53:400
2924199180,10cyclictest29444-21sh09:15:460
2924199180,10cyclictest20662-21sh10:34:540
2924199180,10cyclictest18747-21rm11:03:440
1972199180,7tDemoTimingTask23506-21chrt11:07:585
99499170,10tDemoTimingTask2257-21chrt09:50:005
2924699170,10cyclictest16942-21cat09:35:001
2924199175,6cyclictest5084-21sendmail12:40:000
2924199173,7cyclictest23619-21sh10:36:230
2924199173,12cyclictest26317-21sh09:14:170
2924199172,13cyclictest14190-21sh09:31:390
2924199170,9cyclictest12163-21sh09:58:210
2924199170,9cyclictest10975-21sh12:18:450
3191899162,12tDemoTimingTask3910-21chrt10:48:295
2990629160,14tAtEmLog_01693-21chrt10:16:475
2925999160,9cyclictest13490-21sed12:20:174
2925599164,8cyclictest19458-21tr10:05:163
2925599160,9cyclictest8850-21latency_hist11:50:003
2925599160,9cyclictest13379-21ssh10:58:293
2925599160,9cyclictest13379-21ssh10:58:293
2925099167,7cyclictest22824-21grep10:35:242
2925099160,9cyclictest29305-21sh11:40:022
2925099160,10cyclictest19908-21cron11:05:002
2924699160,10cyclictest31459-21/usr/sbin/munin11:15:211
2924199164,8cyclictest23607-21sh10:08:420
2924199164,10cyclictest3645-21ssh10:48:050
2924199163,6cyclictest1037-21diskstats08:25:150
2924199163,5cyclictest805-21runrttasks08:23:300
2924199163,11cyclictest19228-21sh11:30:430
2924199163,11cyclictest18655-21sh12:25:070
918829150,9tAtEmLog_09685-21taskset10:24:565
2925999153,8cyclictest21994-21kernelversion12:00:194
2925999152,9cyclictest8147-21sh11:22:184
29259991511,3cyclictest16877-21idleruntime-cro08:59:594
2925999150,9cyclictest7761-21/usr/sbin/munin08:40:164
2925999150,9cyclictest21786-21sh09:39:044
2925999150,11cyclictest18099-21sed10:09:034
2925999150,10cyclictest6592-21/usr/sbin/munin07:30:174
2925999150,10cyclictest5040-21rm09:51:394
2925599154,8cyclictest32388-21tune2fs07:15:173
2925599153,9cyclictest23700-21unixbench_multi09:10:243
29255991511,3cyclictest728-21gdbus08:35:003
29255991511,3cyclictest13088-21runrttasks11:53:053
2925599150,11cyclictest20848-21ssh09:38:053
2925599150,10cyclictest25215-21ssh09:41:113
2925099155,8cyclictest11060-21/usr/sbin/munin10:55:212
2925099155,8cyclictest11060-21/usr/sbin/munin10:55:202
2925099153,6cyclictest8944-21apt-get07:35:142
2925099153,6cyclictest8944-21apt-get07:35:132
29250991511,3cyclictest16858-21cron09:00:002
2925099151,10cyclictest7637-21cron09:55:012
2925099151,10cyclictest16-1pr/legacy07:52:082
2925099151,10cyclictest10171-21sh10:25:102
2925099150,9cyclictest6109-21if_enp5s008:35:172
2924699157,6cyclictest11618-21grep10:55:261
2924699157,6cyclictest11618-21grep10:55:251
2924699153,8cyclictest15112-21proc_pri10:00:211
2924699151,10cyclictest19777-21df10:05:271
2924699150,9cyclictest27872-21sendmail_mailtr10:40:231
2924199157,6cyclictest22050-21grep12:00:180
2924199154,8cyclictest0-21swapper/010:17:560
2924199154,7cyclictest27184-21sensors08:10:210
2924199154,4cyclictest0-21swapper/010:12:080
2924199154,3cyclictest0-21swapper/011:55:370
2924199153,9cyclictest781-21postgres10:24:500
2924199153,6cyclictest4489-21/usr/sbin/munin11:45:230
2924199153,10cyclictest9350-21sh11:23:390
2924199153,10cyclictest7308-21/usr/sbin/munin10:50:260
2924199153,10cyclictest26394-21ssh11:10:180
2924199152,9cyclictest3008-21sh09:21:580
2924199152,9cyclictest28543-21sshd11:39:300
2924199152,9cyclictest16553-21sh10:01:400
2924199152,8cyclictest31528-21runrttasks07:14:450
2924199152,8cyclictest12217-21sed08:49:590
2924199152,6cyclictest17415-21df_inode09:35:170
2924199152,5cyclictest27085-21users12:30:260
2924199152,12cyclictest15333-21diskmemload11:28:150
2925999146,7cyclictest920-21munin-node09:02:144
2925999144,7cyclictest353-21systemd-udevd11:09:414
2925999144,7cyclictest26126-21smartctl10:10:164
2925999143,8cyclictest706-21systemd-logind07:52:314
2925999143,8cyclictest353-21systemd-udevd10:53:404
2925999143,8cyclictest23303-21grep11:35:124
2925999143,8cyclictest16803-21sed11:30:004
2925999143,6cyclictest29433-21dpkg11:40:104
2925999142,9cyclictest20200-21uptime07:55:264
2925999141,9cyclictest11376-21swap08:45:274
2925999140,9cyclictest25523-21sh09:41:334
2925999140,10cyclictest805-21runrttasks09:15:064
2925999140,10cyclictest772-21switchtime07:15:264
2925999140,10cyclictest5384-21/usr/sbin/munin08:35:134
2925999140,10cyclictest5287-21runrttasks11:45:474
2925999140,10cyclictest4395-21sh12:39:074
2925999140,10cyclictest29587-21ssh12:06:354
2925999140,10cyclictest29557-21sh11:13:214
2925999140,10cyclictest27202-21grep10:40:184
2925999140,10cyclictest24851-21python308:05:254
2925999140,10cyclictest18476-21ssh11:03:114
2925999140,10cyclictest17849-21grep11:30:164
2925999140,10cyclictest17532-21ssh11:56:164
2925999140,10cyclictest1418-21proc_pri09:20:184
2925999140,10cyclictest12206-21ssh10:26:104
2925999140,10cyclictest11779-21diskstats09:30:144
2925599145,7cyclictest26606-21cut10:40:143
2925599143,8cyclictest706-21systemd-logind12:32:303
2925599141,9cyclictest738-21snmpd09:27:573
2925599141,9cyclictest30759-21sh12:08:003
2925599141,9cyclictest2807-21ls07:20:203
2925599141,9cyclictest18634-21runrttasks11:57:353
2925599141,9cyclictest16977-21timerandwakeup10:30:263
29255991411,2cyclictest6171-21needreboot11:20:193
2925599141,10cyclictest16-1pr/legacy08:52:583
2925599141,10cyclictest16-1pr/legacy07:36:553
2925599141,10cyclictest16-1pr/legacy07:36:553
2925599140,8cyclictest9015-21smartctl08:40:253
2925599140,8cyclictest19403-21sh11:30:543
2925599140,10cyclictest8646-21munin-run07:35:013
2925599140,10cyclictest8115-21/usr/sbin/munin09:55:203
2925599140,10cyclictest805-21runrttasks08:55:013
2925599140,10cyclictest805-21runrttasks07:25:133
2925599140,10cyclictest8009-21sh10:22:513
2925599140,10cyclictest674-21sh10:15:353
2925599140,10cyclictest5412-21basename08:35:123
2925599140,10cyclictest3420-21chrt11:18:403
2925599140,10cyclictest3302-21ssh10:47:373
2925599140,10cyclictest32138-21ssh09:20:003
2925599140,10cyclictest31509-21ssh12:35:023
2925599140,10cyclictest29429-21/usr/sbin/munin11:40:143
2925599140,10cyclictest28804-21sh10:12:333
2925599140,10cyclictest27132-21runrttasks11:10:273
2925599140,10cyclictest2305-21ssh09:50:043
2925599140,10cyclictest2246-21ssh09:20:463
2925599140,10cyclictest20937-21/usr/sbin/munin08:00:313
2925599140,10cyclictest20319-21/usr/sbin/munin11:05:133
2925599140,10cyclictest19339-21latency_hist09:05:013
2925599140,10cyclictest14683-21/usr/sbin/munin11:00:173
2925599140,10cyclictest14197-21ssh09:31:393
2925599140,10cyclictest12303-21cat12:20:003
2925099146,6cyclictest23281-21cut09:40:162
2925099145,7cyclictest29345-21cut09:45:152
2925099141,9cyclictest8446-21cpuspeed_turbos09:55:152
2925099141,9cyclictest805-21runrttasks08:05:112
2925099141,9cyclictest4443-21sh10:20:042
2925099141,9cyclictest10100-21sshd08:45:052
2925099141,11cyclictest16-1pr/legacy08:02:172
2925099141,10cyclictest4715-21latency_hist11:20:012
2925099141,10cyclictest16-1pr/legacy12:31:032
2925099141,10cyclictest15751-21wc10:30:152
2925099140,9cyclictest9809-21latency_hist08:45:002
2925099140,10cyclictest805-21runrttasks11:36:122
2925099140,10cyclictest805-21runrttasks11:05:202
2925099140,10cyclictest7462-21chrt11:21:272
2925099140,10cyclictest692-21wget08:25:132
2925099140,10cyclictest6134-21ssh12:15:012
2925099140,10cyclictest5554-21sh12:14:402
2925099140,10cyclictest5509-21ssh09:25:112
2925099140,10cyclictest3494-21/usr/sbin/munin08:30:152
2925099140,10cyclictest31757-21ssh12:09:132
2925099140,10cyclictest30906-21sed10:15:042
2925099140,10cyclictest30626-21proc_pri07:10:202
2925099140,10cyclictest29933-21grep10:14:092
2925099140,10cyclictest25252-21/usr/sbin/munin11:10:112
2925099140,10cyclictest24752-21sh09:12:272
2925099140,10cyclictest2375-21runrttasks12:36:502
2925099140,10cyclictest22348-21sh12:00:212
2925099140,10cyclictest21882-21ssh10:06:322
2925099140,10cyclictest21155-21ssh12:26:002
2925099140,10cyclictest19499-21cat09:05:002
2925099140,10cyclictest17150-21wget11:30:122
2925099140,10cyclictest15001-21/usr/sbin/munin11:55:192
2925099140,10cyclictest13969-21tr10:00:142
2925099140,10cyclictest12904-21ssh11:25:322
2925099140,10cyclictest11414-21grep07:40:122
2924699141,9cyclictest9759-21runrttasks08:44:291
2924699141,9cyclictest805-21runrttasks11:25:571
2924699141,9cyclictest805-21runrttasks10:54:171
2924699141,9cyclictest805-21runrttasks09:19:491
2924699141,9cyclictest5284-21sh09:52:011
2924699141,9cyclictest31177-21/usr/sbin/munin10:15:161
2924699141,9cyclictest29466-21/usr/sbin/munin11:40:111
2924699141,9cyclictest22054-21sh09:10:121
2924699140,9cyclictest29508-21/usr/sbin/munin07:10:241
2924699140,12cyclictest766-21df10:45:161
2924699140,10cyclictest8469-21ssh11:22:411
2924699140,10cyclictest8466-21taskset07:32:471
2924699140,10cyclictest8129-21ssh10:22:581
2924699140,10cyclictest805-21runrttasks07:41:291
2924699140,10cyclictest575-21/usr/sbin/munin08:25:141
2924699140,10cyclictest5493-21/usr/sbin/munin09:25:231
2924699140,10cyclictest3755-21runrttasks09:23:121
2924699140,10cyclictest334-21systemd-journal12:05:131
2924699140,10cyclictest3337-21ssh12:37:581
2924699140,10cyclictest30678-21/usr/sbin/munin08:20:131
2924699140,10cyclictest3030-21/usr/sbin/munin08:30:131
2924699140,10cyclictest27916-21ssh11:11:211
2924699140,10cyclictest24267-21memory11:35:171
2924699140,10cyclictest23647-21chrt12:01:111
2924699140,10cyclictest22736-21/usr/sbin/munin09:40:191
2924699140,10cyclictest2205-21latency_hist09:50:011
2924699140,10cyclictest21288-21wget10:35:121
2924699140,10cyclictest20920-21fschecks_time11:05:151
2924699140,10cyclictest20517-21ssh11:32:111
2924699140,10cyclictest1955-21/usr/sbin/munin12:10:201
2924699140,10cyclictest19542-21/usr/sbin/munin09:05:211
2924699140,10cyclictest16889-21ssh11:55:331
2924699140,10cyclictest15419-21aten2_r5power_c10:30:131
2924699140,10cyclictest11598-21sh11:51:161
2924699140,10cyclictest11314-21ssh09:57:101
2924699140,10cyclictest10193-21/usr/sbin/munin10:25:151
2924199146,6cyclictest30080-21taskset10:42:300
2924199144,8cyclictest5003-21uname07:25:200
2924199144,8cyclictest433-21apt-config12:10:000
2924199144,8cyclictest24749-21ssh11:09:560
2924199143,7cyclictest31298-21runintdemo5min11:15:010
2924199143,6cyclictest9160-21/usr/sbin/munin11:50:140
2924199143,6cyclictest6099-21perl09:25:130
2924199142,8cyclictest5745-21diskstats08:35:140
2924199142,8cyclictest23112-21ls09:40:130
2924199142,8cyclictest18510-21sed07:55:000
2924199142,8cyclictest12537-21sh10:26:430
2924199141,9cyclictest3910-21missed_timers08:30:170
2924199141,9cyclictest20209-21hddtemp_smartct09:05:160
2924199141,11cyclictest11041-21latency_hist07:40:010
2924199141,11cyclictest11041-21latency_hist07:40:000
2924199140,7cyclictest10276-21diskstats10:55:150
2924199140,7cyclictest10276-21diskstats10:55:140
2924199140,10cyclictest7765-21apt-get08:40:150
2924199140,10cyclictest26729-21ssh12:05:040
2924199140,10cyclictest2128-21cut07:20:160
2924199140,10cyclictest15513-21hddtemp_smartct08:55:380
3191899130,11tDemoTimingTask31942-21chrt10:44:345
2925999131,9cyclictest19263-21cut12:25:154
2925999131,8cyclictest4575-21cut10:20:134
2925999130,9cyclictest9272-21cpuspeed_turbos07:35:144
2925999130,9cyclictest9272-21cpuspeed_turbos07:35:144
2925999130,9cyclictest8792-21gltestperf09:55:184
2925999130,9cyclictest805-21runrttasks12:10:344
2925999130,9cyclictest805-21runrttasks10:30:024
2925999130,9cyclictest805-21runrttasks09:10:014
2925999130,9cyclictest738-21snmpd07:20:004
2925999130,9cyclictest6293-21/usr/sbin/munin12:15:154
2925999130,9cyclictest5460-21taskset09:25:084
2925999130,9cyclictest4407-21cpuspeed07:25:144
2925999130,9cyclictest3704-21hddtemp_smartct08:30:164
2925999130,9cyclictest32441-21missed_timers11:15:214
2925999130,9cyclictest30823-21apt-config10:15:044
2925999130,9cyclictest30740-21aten2_r5power_e08:20:134
2925999130,9cyclictest29910-21fschecks_count07:10:154
2925999130,9cyclictest28712-21ssh09:45:064
2925999130,9cyclictest25248-21diskmemload12:30:104
2925999130,9cyclictest22527-21/usr/sbin/munin10:35:214
2925999130,9cyclictest21063-21grep08:00:204
2925999130,9cyclictest19609-21tr09:05:124
2925999130,9cyclictest1621-21cat08:25:174
2925999130,9cyclictest13917-21/usr/sbin/munin10:00:254
2925999130,9cyclictest11356-21/usr/sbin/munin07:40:194
2925999130,8cyclictest747-21rm10:45:164
2925999130,10cyclictest13968-21sed08:50:244
2925999130,10cyclictest11987-21runrttasks11:51:474
2925599135,6cyclictest26340-21tune2fs08:10:143
2925599135,6cyclictest17087-21memory07:50:213
2925599130,9cyclictest805-21runrttasks10:52:263
2925599130,9cyclictest805-21runrttasks07:55:073
2925599130,9cyclictest738-21snmpd11:25:033
2925599130,9cyclictest668-21/usr/sbin/munin12:10:203
2925599130,9cyclictest30678-21/usr/sbin/munin08:20:213
2925599130,9cyclictest24049-21sh11:35:163
2925599130,9cyclictest23590-21/usr/sbin/munin08:05:163
2925599130,9cyclictest15910-21sh12:22:213
2925599130,9cyclictest15012-21netstat10:00:203
2925599130,9cyclictest14555-21if_enp5s007:45:183
2925599130,9cyclictest1279-21tail08:25:153
2925599130,9cyclictest12667-21sendmail_mailqu07:40:223
2925599130,10cyclictest29996-21runrttasks08:15:593
2925599130,10cyclictest29711-21cpuspeed_turbos07:10:143
2925599130,10cyclictest29172-21diskstats09:45:143
2925599130,10cyclictest21689-21fschecks_count10:35:153
2925599130,10cyclictest21055-21runrttasks12:00:073
2925599130,10cyclictest21006-21ssh12:25:533
2925099130,9cyclictest8217-21awk07:30:282
2925099130,9cyclictest805-21runrttasks07:17:532
2925099130,9cyclictest738-21snmpd08:10:062
2925099130,9cyclictest5358-21runrttasks10:50:012
2925099130,9cyclictest32765-21sh10:45:112
2925099130,9cyclictest32557-21ssh09:20:092
2925099130,9cyclictest30678-21/usr/sbin/munin08:20:182
2925099130,9cyclictest28295-21/usr/sbin/munin08:15:202
2925099130,9cyclictest27383-21sh09:15:102
2925099130,9cyclictest19145-21gltestperf07:55:152
2925099130,9cyclictest18988-21ssh09:35:402
2925099130,9cyclictest1886-21/usr/sbin/munin07:20:192
2925099130,9cyclictest14338-21tune2fs07:45:162
2925099130,9cyclictest13581-21needreboot12:20:172
2925099130,9cyclictest12421-21uname09:30:172
2925099130,9cyclictest10299-21sh11:50:202
2925099130,10cyclictest26819-21grep10:40:162
2925099130,10cyclictest19896-21df09:05:132
2924699131,9cyclictest6526-21cpuspeed_turbos12:15:141
2924699130,9cyclictest4528-21python311:45:251
2924699130,9cyclictest4235-21/usr/sbin/munin07:25:171
2924699130,9cyclictest29432-21latency_hist07:10:001
2924699130,9cyclictest28299-21ssh12:31:481
2924699130,9cyclictest28295-21/usr/sbin/munin08:15:161
2924699130,9cyclictest25942-21/usr/sbin/munin08:10:141
2924699130,9cyclictest22624-21runrttasks08:00:521
2924699130,9cyclictest18910-21ssh09:35:341
2924699130,9cyclictest1885-21runrttasks07:20:131
2924699130,9cyclictest18809-21aten2_r5power_p12:25:121
2924699130,9cyclictest18566-21/usr/sbin/munin07:55:191
2924699130,9cyclictest18217-21ssh12:24:541
2924699130,9cyclictest17193-21/usr/sbin/munin09:00:131
2924699130,9cyclictest16794-21runrttasks08:59:101
2924699130,9cyclictest14666-21ssh11:00:101
2924699130,9cyclictest14373-21runrttasks08:53:131
2924699130,9cyclictest14135-21tr07:45:151
2924699130,9cyclictest1360-21runrttasks07:17:281
2924699130,10cyclictest805-21runrttasks10:10:381
2924699130,10cyclictest23440-21apt-key08:05:001
2924699130,10cyclictest16304-21aten2_r5power_p07:50:141
2924699130,10cyclictest11354-21sensors08:45:231
2924699130,10cyclictest10366-21cat07:35:261
2924699130,10cyclictest10366-21cat07:35:251
2924199133,6cyclictest11359-21apt-get07:40:120
2924199132,6cyclictest32212-21df07:15:150
2924199131,8cyclictest13146-21basename08:50:170
2924199130,9cyclictest22202-21runrttasks08:00:280
2924199130,9cyclictest15332-21cat07:45:260
2924199130,7cyclictest146-1kworker/0:1H+kblockd09:00:520
2924199130,6cyclictest18900-21/usr/sbin/munin07:55:140
2924199130,10cyclictest7386-21grep07:30:200
2924199130,10cyclictest23717-21grep08:05:150
2884199130,11tDemoTimingTask29771-21chrt12:06:525
486239120,0EcMasterDemoSyn0-21swapper/508:32:425
3125739120,0EcMasterDemoSyn0-21swapper/507:11:355
2925999120,9cyclictest26766-21/usr/sbin/munin08:10:174
2925999120,7cyclictest29196-21latency_hist07:10:014
2925599121,7cyclictest19660-21wget09:05:133
2925599120,9cyclictest10497-21fschecks_count08:45:183
2924699120,9cyclictest5658-21expr08:35:131
2924199120,7cyclictest29146-21cat08:15:200
2924199120,10cyclictest29431-21cat07:10:000
2775339120,1EcMasterDemoSyn671rcuc/508:12:265
2716239120,0EcMasterDemoSyn0-21swapper/509:43:435
2402439120,0EcMasterDemoSyn0-21swapper/511:35:165
2142399120,10tDemoTimingTask25014-21chrt09:12:485
169399120,10tDemoTimingTask3274-21chrt12:37:525
1693529120,10tAtEmLog_020331-21chrt11:59:315
1567099120,10tDemoTimingTask18917-21taskset09:35:345
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional