You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-22 - 03:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Wed Apr 22, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28399391170,0EcMasterDemoSyn28405-21ps21:07:251
212039850,4EcMasterDemoSyn2129-21runintdemo5min21:48:004
1598339830,0EcMasterDemoSyn1599329tAtEmLog_022:13:205
643339820,0EcMasterDemoSyn644329tAtEmLog_022:43:475
473139820,0EcMasterDemoSyn474129tAtEmLog_023:54:455
3238239820,0EcMasterDemoSyn3239229tAtEmLog_020:06:345
557739810,0EcMasterDemoSyn558729tAtEmLog_023:19:165
334539810,0EcMasterDemoSyn335529tAtEmLog_019:05:435
2388539810,0EcMasterDemoSyn2389529tAtEmLog_023:29:245
232839810,0EcMasterDemoSyn233829tAtEmLog_020:11:385
2292939810,0EcMasterDemoSyn2293929tAtEmLog_019:46:175
2083939810,0EcMasterDemoSyn2084929tAtEmLog_021:58:075
311812330,0sleep00-21swapper/022:03:590
27409292423,0tAtEmLog_00-21swapper/500:30:145
2029829240,0tAtEmLog_00-21swapper/521:27:415
375899201,10cyclictest13090-21sh22:11:210
2533039200,1EcMasterDemoSyn25338-21grep21:42:552
375899190,15cyclictest32757-21sh22:22:250
375899184,10cyclictest30054-21awk23:15:000
375899180,15cyclictest31467-21sh21:28:510
375899180,10cyclictest30839-21sh23:50:220
375899180,10cyclictest16011-21sh00:36:100
1058399180,11tDemoTimingTask10607-21chrt23:04:045
945099170,14tDemoTimingTask9589-21taskset20:28:235
377399176,6cyclictest648-21dbus-daemon00:30:193
3768991714,2cyclictest19207-21turbostat20:54:552
375899170,9cyclictest8875-21sh23:56:190
375899170,9cyclictest22192-21sh00:21:420
375899170,9cyclictest16928-21sh22:31:040
375899170,9cyclictest14689-21sh00:17:450
375899170,12cyclictest5888-21ssh22:25:200
375899170,12cyclictest12545-21cat00:35:010
3001939170,15EcMasterDemoSyn5798-21chrt22:07:355
2841099170,10tDemoTimingTask28937-21chrt21:10:005
188699170,10tDemoTimingTask2006-21chrt22:23:325
1563899170,10tDemoTimingTask17189-21taskset22:49:555
1382699170,10tDemoTimingTask14018-21chrt23:59:565
945099160,13tDemoTimingTask11713-21chrt20:30:535
377399160,9cyclictest9939-21ssh22:27:483
377399160,10cyclictest13658-21sh23:59:443
376499164,9cyclictest716-21snmpd21:51:051
376499160,13cyclictest20403-21vmstat00:20:261
375899164,10cyclictest30880-21cpuspeed_turbos23:15:140
375899160,7cyclictest15634-21ssh23:06:120
375899160,14cyclictest15443-21ssh21:55:140
375899160,13cyclictest780-21runrttasks20:41:260
375899160,12cyclictest25930-21sh22:54:440
2765429160,9tAtEmLog_027686-21chrt19:56:295
2529999160,9tDemoTimingTask25303-21chrt19:51:225
1416729160,9tAtEmLog_014172-21taskset20:37:005
975039150,13EcMasterDemoSyn15496-21taskset23:42:115
377799150,9cyclictest7773-21sh00:14:174
377799150,9cyclictest3399-21sh00:30:004
377799150,8cyclictest9141-21ssh23:03:024
377399156,7cyclictest1131-21tr22:05:143
377399154,8cyclictest1160-21grep20:10:153
3773991511,3cyclictest13738-21gdbus22:35:063
377399151,10cyclictest4761-21runrttasks23:18:423
377399150,6cyclictest8698-21sh23:20:213
377399150,11cyclictest21823-21ssh21:40:273
376899154,8cyclictest20576-21cut19:46:162
376899154,6cyclictest5529-21latency_hist21:15:002
376899154,6cyclictest13376-21find22:30:002
376899150,11cyclictest16-1pr/legacy21:58:072
3764991511,3cyclictest21045-21cron23:10:001
376499151,10cyclictest14848-21ssh00:17:521
376499151,10cyclictest12424-21sh21:18:321
376499150,9cyclictest25090-21ssh23:11:321
376499150,9cyclictest13300-21sh23:59:291
376499150,11cyclictest9625-21chrt23:03:251
375899158,5cyclictest16-1pr/legacy19:46:160
375899156,7cyclictest780-21runrttasks23:37:470
375899156,7cyclictest31322-21sh21:10:320
375899156,7cyclictest16860-21cat21:20:240
375899156,7cyclictest16860-21cat21:20:240
375899156,7cyclictest10842-21sh21:17:280
375899154,8cyclictest780-21runrttasks21:50:080
375899153,9cyclictest30382-21sh22:56:320
375899151,12cyclictest18162-21/usr/sbin/munin23:25:250
375899151,11cyclictest24482-21/usr/sbin/munin22:35:210
375899150,7cyclictest174-1kworker/0:1H+kblockd20:58:470
375899150,13cyclictest450-21aten2_r5power_e00:10:120
375899150,12cyclictest28640-21diskmemload23:32:030
375899150,12cyclictest28242-21sh21:44:560
375899150,11cyclictest14654-21sh22:48:100
375899150,10cyclictest9696-21ssh23:03:270
375899150,10cyclictest13426-21taskset19:29:390
375899150,10cyclictest13426-21taskset19:29:380
1660299150,9tDemoTimingTask16633-21chrt20:42:075
377799147,6cyclictest903-21gpm00:21:384
377799147,6cyclictest7078-21grep21:15:194
377799144,5cyclictest16901-21awk00:00:254
377799141,9cyclictest9058-21/usr/sbin/munin19:20:164
377799141,9cyclictest780-21runrttasks22:18:064
377799141,9cyclictest15897-21ssh22:13:174
377799141,9cyclictest14201-21runrttasks23:41:184
3777991410,3cyclictest24784-21sh23:30:004
377799140,9cyclictest16-1pr/legacy22:58:574
377799140,10cyclictest8828-21wget22:45:124
377799140,10cyclictest6660-21hddtemp_smartct21:50:154
377799140,10cyclictest4665-21/usr/sbin/munin22:25:194
377799140,10cyclictest3867-21sh21:13:574
377799140,10cyclictest3697-21sh22:41:514
377799140,10cyclictest32656-21ssh22:22:204
377799140,10cyclictest3029-21rm23:17:284
377799140,10cyclictest26580-21/usr/sbin/munin21:05:204
377799140,10cyclictest25992-21grep19:55:124
377799140,10cyclictest11273-21sh23:21:544
377399146,6cyclictest4299-21gdbus19:10:013
377399141,9cyclictest32671-21sh23:34:143
377399141,9cyclictest29464-21sh23:50:123
377399141,9cyclictest2924-21/usr/sbin/munin20:15:173
377399141,10cyclictest6277-21runrttasks23:37:053
377399140,9cyclictest7479-21sh00:14:043
377399140,10cyclictest9946-21sh23:03:373
377399140,10cyclictest9927-21cut20:30:003
377399140,10cyclictest9766-21df00:15:123
377399140,10cyclictest780-21runrttasks21:09:113
377399140,10cyclictest6408-21/usr/sbin/munin21:15:153
377399140,10cyclictest6315-21/usr/sbin/munin21:50:143
377399140,10cyclictest3715-21sh22:24:453
377399140,10cyclictest31931-21ssh21:10:583
377399140,10cyclictest29916-21memory21:45:183
377399140,10cyclictest29608-21cat20:00:233
377399140,10cyclictest29045-21ssh21:27:123
377399140,10cyclictest27371-21chrt00:25:113
377399140,10cyclictest2622-21mailstats21:30:203
377399140,10cyclictest24557-21sh23:47:143
377399140,10cyclictest24099-21/usr/sbin/munin00:05:213
377399140,10cyclictest21573-21/usr/sbin/munin23:10:183
377399140,10cyclictest21317-21tr19:45:123
377399140,10cyclictest20205-21proc_pri22:15:183
377399140,10cyclictest19811-21ssh21:57:243
377399140,10cyclictest19404-21ssh00:02:063
377399140,10cyclictest19250-21sh22:50:193
377399140,10cyclictest1921-21ssh22:40:343
377399140,10cyclictest1904-21ssh22:59:173
377399140,10cyclictest18796-21sh23:44:323
377399140,10cyclictest17808-21sh23:25:233
377399140,10cyclictest17721-21sh22:31:383
377399140,10cyclictest16174-21/usr/sbin/munin19:35:193
377399140,10cyclictest15403-21ssh22:12:573
377399140,10cyclictest15170-21/usr/sbin/munin21:20:173
377399140,10cyclictest15170-21/usr/sbin/munin21:20:173
377399140,10cyclictest14800-21/usr/sbin/munin20:40:233
377399140,10cyclictest13505-21sh00:35:173
377399140,10cyclictest12528-21ssh23:05:133
377399140,10cyclictest11553-21ssh22:46:003
377399140,10cyclictest10665-21/usr/sbin/munin21:35:133
376899147,6cyclictest26128-21grep21:25:232
376899141,9cyclictest30648-21aten2_r5power_c23:15:132
376899141,9cyclictest2776-21latency_hist20:15:002
376899141,9cyclictest27677-21runrttasks22:01:322
376899141,9cyclictest18924-21/usr/sbin/munin22:15:222
376899141,9cyclictest13262-21ssh22:47:132
376899141,9cyclictest10214-21sh21:17:022
376899141,10cyclictest23255-21timerandwakeup23:10:242
376899141,10cyclictest1835-21ssh23:35:062
376899140,10cyclictest9546-21sh00:32:592
376899140,10cyclictest9396-21diskmemload23:56:412
376899140,10cyclictest8051-21sh22:44:532
376899140,10cyclictest7211-21ssh00:13:532
376899140,10cyclictest3475-21rm22:05:572
376899140,10cyclictest326-21systemd-journal00:05:052
376899140,10cyclictest30949-21ssh00:26:312
376899140,10cyclictest30506-21cut20:05:002
376899140,10cyclictest3009-21sh21:48:362
376899140,10cyclictest29582-21ssh23:32:032
376899140,10cyclictest28602-21cat22:55:242
376899140,10cyclictest2491-21open_files21:30:192
376899140,10cyclictest24165-21latency_hist21:00:012
376899140,10cyclictest22122-21ssh22:52:042
376899140,10cyclictest20042-21/usr/sbin/munin23:45:182
376899140,10cyclictest19368-21ssh00:02:052
376899140,10cyclictest18874-21df_inode00:20:142
376899140,10cyclictest18763-21runrttasks21:39:402
376899140,10cyclictest17530-21fschecks_count20:45:132
376899140,10cyclictest17008-21ssh22:14:032
376899140,10cyclictest15327-21chrt22:30:182
376899140,10cyclictest15152-21df20:40:132
376899140,10cyclictest13043-21hddtemp_smartct20:35:162
376899140,10cyclictest1290-21sh23:52:192
376899140,10cyclictest12848-21ssh00:35:092
376899140,10cyclictest12547-21/usr/sbin/munin23:05:132
376899140,10cyclictest12005-21runrttasks20:34:132
376899140,10cyclictest11392-21ssh23:40:152
376899140,10cyclictest11213-21grep00:15:232
376499146,6cyclictest24989-21grep22:35:251
376499145,8cyclictest15923-21/usr/sbin/munin22:30:231
376499143,8cyclictest6430-21wc20:20:201
376499141,9cyclictest5425-21hddtemp_smartct22:25:171
376499141,9cyclictest30607-21/usr/sbin/munin23:15:211
376499141,9cyclictest30489-21rm00:26:111
376499141,9cyclictest3011-21runrttasks00:10:541
376499141,9cyclictest29805-21sh21:27:431
376499141,9cyclictest29507-21ssh22:55:541
376499141,10cyclictest6417-21ssh00:30:441
376499141,10cyclictest26152-21runrttasks21:03:221
3764991410,3cyclictest695-21rs:main1
376499140,9cyclictest4069-21ssh23:35:311
376499140,10cyclictest880-21sh22:22:481
376499140,10cyclictest653-21sh23:51:541
376499140,10cyclictest5864-21ssh22:43:211
376499140,10cyclictest5362-21ssh22:07:161
376499140,10cyclictest3546-21ssh21:30:391
376499140,10cyclictest30753-21ssh21:10:241
376499140,10cyclictest29642-21ssh21:45:151
376499140,10cyclictest28275-21/usr/sbin/munin20:00:161
376499140,10cyclictest28141-21ssh00:07:001
376499140,10cyclictest26919-21switchtime23:30:241
376499140,10cyclictest24581-21ssh22:00:141
376499140,10cyclictest23251-21apt19:50:001
376499140,10cyclictest22556-21ssh23:45:481
376499140,10cyclictest21816-21rm22:16:051
376499140,10cyclictest20254-21ssh22:50:431
376499140,10cyclictest20019-21ssh00:02:331
376499140,10cyclictest19224-21ssh00:38:281
376499140,10cyclictest18906-21sh23:44:371
376499140,10cyclictest18195-21seq19:39:461
376499140,10cyclictest18158-21ssh21:56:161
376499140,10cyclictest16660-21ssh21:20:231
376499140,10cyclictest16660-21ssh21:20:221
376499140,10cyclictest12867-21ssh22:46:551
376499140,10cyclictest12729-21ssh21:35:301
376499140,10cyclictest12391-21ssh22:10:511
375899145,7cyclictest3763-21ssh22:41:520
375899145,7cyclictest12073-21latency_hist20:35:000
375899141,9cyclictest25567-21taskset19:54:400
375899141,7cyclictest2443-21/usr/sbin/munin21:30:180
375899141,6cyclictest24523-21fschecks_count00:05:160
375899141,10cyclictest9720-21latency_hist20:30:010
375899141,10cyclictest12807-21rm23:40:250
375899140,8cyclictest4755-21runrttasks20:17:000
375899140,8cyclictest174-1kworker/0:1H+kblockd19:10:360
375899140,7cyclictest7998-21sed23:20:150
375899140,7cyclictest20067-21atemtest23:45:110
375899140,12cyclictest30006-21cat21:45:180
375899140,12cyclictest2734-21users22:05:270
375899140,11cyclictest15466-21sh00:00:130
375899140,10cyclictest780-21runrttasks20:35:220
375899140,10cyclictest30259-21ssh00:26:010
375899140,10cyclictest29829-21unixbench_multi20:00:240
375899140,10cyclictest19722-21memory19:40:170
375899140,10cyclictest13902-21sh21:36:190
2029829146,6tAtEmLog_023701-21turbostat21:25:015
2029829146,6tAtEmLog_023701-21turbostat21:25:005
916399131,10tDemoTimingTask12706-21taskset00:16:245
58439130,0EcMasterDemoSyn0-21swapper/523:34:285
377799135,6cyclictest8445-21cut20:25:184
377799135,6cyclictest20044-21tr19:40:204
377799134,8cyclictest24616-21/usr/sbin/munin21:25:124
377799131,9cyclictest24560-21fschecks_count00:05:154
377799131,9cyclictest13764-21/usr/sbin/munin19:30:174
377799130,9cyclictest9254-21sh00:15:054
377799130,9cyclictest6685-21/usr/sbin/munin19:15:174
377799130,9cyclictest6685-21/usr/sbin/munin19:15:174
377799130,9cyclictest5711-21sh00:30:234
377799130,9cyclictest5636-21/usr/sbin/munin23:55:104
377799130,9cyclictest4324-21/usr/sbin/munin19:10:194
377799130,9cyclictest29181-21ssh23:31:464
377799130,9cyclictest28275-21/usr/sbin/munin20:00:204
377799130,9cyclictest23495-21ssh23:46:294
377799130,9cyclictest23035-21ssh22:35:094
377799130,9cyclictest22645-21timerwakeupswit19:45:234
377799130,9cyclictest20336-21latency20:50:174
377799130,9cyclictest1978-21/usr/sbin/munin23:35:154
377799130,9cyclictest19693-21ssh21:40:064
377799130,9cyclictest18535-21sh21:21:254
377799130,9cyclictest18535-21sh21:21:244
377799130,9cyclictest14800-21/usr/sbin/munin20:40:164
377799130,9cyclictest1365-21fschecks_time22:05:164
377799130,9cyclictest12526-21/usr/sbin/munin23:05:164
377799130,9cyclictest12374-21/usr/sbin/munin20:35:134
377799130,9cyclictest11411-21/usr/sbin/munin19:25:184
377799130,9cyclictest11411-21/usr/sbin/munin19:25:184
377799130,9cyclictest11382-21gltestperf21:35:164
377799130,9cyclictest10019-21/usr/sbin/munin20:30:254
377799130,7cyclictest29038-21ssh23:50:094
377799130,10cyclictest780-21runrttasks19:35:404
377799130,10cyclictest716-21snmpd22:32:434
377799130,10cyclictest5763-21ssh21:32:124
377799130,10cyclictest24289-21ssh23:10:584
377799130,10cyclictest23943-21ssh22:00:054
377799130,10cyclictest23551-21/usr/sbin/munin19:50:194
377799130,10cyclictest19280-21smartctl22:50:204
377799130,10cyclictest15001-21ssh21:55:104
377799130,10cyclictest1329-21uname20:10:174
377799130,10cyclictest13262-21cpuspeed_turbos00:35:154
377399134,8cyclictest11773-21/usr/sbin/munin19:25:133
377399134,8cyclictest11773-21/usr/sbin/munin19:25:133
377399130,9cyclictest9058-21/usr/sbin/munin19:20:193
377399130,9cyclictest716-21snmpd21:00:493
377399130,9cyclictest7018-21cstates19:15:143
377399130,9cyclictest7018-21cstates19:15:143
377399130,9cyclictest6574-21taskset20:20:223
377399130,9cyclictest30630-21/usr/sbin/munin20:05:183
377399130,9cyclictest26279-21forks19:55:143
377399130,9cyclictest24115-21apt-get22:00:113
377399130,9cyclictest23551-21/usr/sbin/munin19:50:183
377399130,9cyclictest18848-21/usr/sbin/munin19:40:203
377399130,9cyclictest17153-21/usr/sbin/munin20:45:143
377399130,9cyclictest11245-21mailstats20:30:223
377399130,10cyclictest21287-21chrt20:52:073
377399130,10cyclictest20575-21sh00:20:323
377399130,10cyclictest15789-21chrt19:33:593
376899131,9cyclictest9729-21hddtemp_smartct19:20:142
376899130,9cyclictest8235-21unixbench_multi19:15:242
376899130,9cyclictest8235-21unixbench_multi19:15:242
376899130,9cyclictest780-21runrttasks19:35:102
376899130,9cyclictest7785-21tr20:25:132
376899130,9cyclictest7045-21diskmemload23:20:022
376899130,9cyclictest6186-21runrttasks19:12:282
376899130,9cyclictest5819-21ssh21:50:092
376899130,9cyclictest3326-21ssh23:00:042
376899130,9cyclictest30630-21/usr/sbin/munin20:05:162
376899130,9cyclictest2924-21/usr/sbin/munin20:15:162
376899130,9cyclictest26614-21wget21:05:122
376899130,9cyclictest25938-21grep19:55:122
376899130,9cyclictest25615-21timerandwakeup21:00:242
376899130,9cyclictest23551-21/usr/sbin/munin19:50:242
376899130,9cyclictest23092-21/usr/sbin/munin22:35:182
376899130,9cyclictest19882-21awk19:40:182
376899130,9cyclictest15143-21rm21:20:102
376899130,9cyclictest15143-21rm21:20:102
376899130,9cyclictest13880-21wget19:30:132
376899130,9cyclictest11411-21/usr/sbin/munin19:25:172
376899130,9cyclictest11411-21/usr/sbin/munin19:25:172
376899130,10cyclictest27853-21ssh22:20:062
376899130,10cyclictest18587-21sh23:25:392
376499130,9cyclictest9907-21ls20:30:001
376499130,9cyclictest9394-21cstates19:20:121
376499130,9cyclictest6685-21/usr/sbin/munin19:15:171
376499130,9cyclictest6685-21/usr/sbin/munin19:15:171
376499130,9cyclictest6004-21chrt19:10:411
376499130,9cyclictest30630-21/usr/sbin/munin20:05:191
376499130,9cyclictest21857-21/usr/sbin/munin20:55:181
376499130,9cyclictest14800-21/usr/sbin/munin20:40:121
376499130,9cyclictest13764-21/usr/sbin/munin19:30:241
376499130,9cyclictest13357-21runrttasks19:28:421
376499130,9cyclictest13357-21runrttasks19:28:421
376499130,9cyclictest10019-21/usr/sbin/munin20:30:131
376499130,10cyclictest8056-21ssh23:20:161
376499130,10cyclictest3176-21tr20:15:131
376499130,10cyclictest25495-21runrttasks19:53:401
376499130,10cyclictest2346-21runintdemo5min20:11:391
376499130,10cyclictest20789-21runrttasks19:43:391
376499130,10cyclictest20238-21sh21:40:141
376499130,10cyclictest19695-21sh23:26:251
375899137,3cyclictest2130439EcMasterDemoSyn20:52:120
375899130,9cyclictest780-21runrttasks20:06:140
375899130,9cyclictest716-21snmpd20:46:490
375899130,9cyclictest24229-21/usr/sbin/munin21:00:150
375899130,11cyclictest1621-21ntp_kernel_pll_20:10:180
375899130,11cyclictest10183-21processes19:20:180
375899130,10cyclictest6581-21swap20:20:230
375899130,10cyclictest174-1kworker/0:1H+kblockd22:15:000
375899130,10cyclictest174-1kworker/0:1H+kblockd21:06:540
375899130,10cyclictest174-1kworker/0:1H+kblockd19:55:080
375899130,10cyclictest14116-21df19:30:130
3003099131,10tDemoTimingTask32306-21taskset22:04:475
1563899131,10tDemoTimingTask21378-21taskset22:51:315
1416499130,7tDemoTimingTask16691-21taskset00:36:385
839499120,10tDemoTimingTask8495-21taskset19:16:525
839499120,10tDemoTimingTask8495-21taskset19:16:525
602339120,0EcMasterDemoSyn0-21swapper/519:10:475
377799124,6cyclictest648-21dbus-daemon20:50:004
377799120,9cyclictest5309-21/usr/sbin/munin20:20:144
377799120,9cyclictest32350-21taskset20:06:194
377799120,9cyclictest3000-21aten2_r5power_p20:15:134
377799120,9cyclictest24393-21grep21:00:124
377799120,9cyclictest22419-21fschecks_time20:55:154
377399124,6cyclictest22235-21fschecks_count20:55:153
377399120,9cyclictest3960-21cat19:10:003
377399120,9cyclictest12743-21cat20:35:153
376899120,9cyclictest5311-21runrttasks20:20:112
376899120,9cyclictest3802-21latency_hist19:10:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional