You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-12-10 - 01:43
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by a total of 2 SMIs that occured during the measurement.
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot2.osadl.org (updated Sat Dec 09, 2023 12:43:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
433599143134,8cyclictest0-21swapper/108:53:081
4025211146,32sleep10-21swapper/107:12:171
4337999693,2cyclictest17874-21strings08:53:083
195522920,0sleep00-21swapper/008:58:030
394929148,32sleep20-21swapper/207:11:172
373629149,31sleep00-21swapper/007:08:300
174752910,0sleep10-21swapper/110:41:051
388329048,30sleep30-21swapper/307:10:263
4334998987,1cyclictest0-21swapper/008:53:080
164072860,0sleep00-21swapper/009:35:430
4336997775,1cyclictest0-21swapper/207:12:582
4337993319,1cyclictest0-21swapper/310:47:593
4334993325,7cyclictest0-21swapper/007:16:550
433599291,1cyclictest0-21swapper/110:47:591
4337992820,6cyclictest4392-21ntp_states09:23:093
29762280,1sleep20-21swapper/211:57:492
4335992622,2cyclictest28490-21ssh12:22:571
28272250,0sleep30-21swapper/310:27:403
225172250,1sleep3331rcuc/309:42:113
31662240,1sleep012-21ksoftirqd/010:28:010
4337992220,1cyclictest0-21swapper/309:13:023
433799221,1cyclictest0-21swapper/310:53:003
433499221,20cyclictest0-21swapper/010:53:010
292922220,0sleep20-21swapper/210:21:542
433699210,1cyclictest0-21swapper/208:12:592
433499200,1cyclictest0-21swapper/008:12:590
108462200,0sleep00-21swapper/012:04:400
187032190,0sleep30-21swapper/307:43:043
150612190,0sleep20-21swapper/210:07:312
433699175,7cyclictest0-21swapper/208:10:252
433499169,6cyclictest12-21ksoftirqd/012:17:390
433499165,6cyclictest0-21swapper/011:48:580
433499164,7cyclictest0-21swapper/010:34:080
433499163,8cyclictest18304-21/usr/sbin/munin09:38:030
42932163,9sleep30-21swapper/307:12:433
433599152,5cyclictest0-21swapper/112:33:061
433499150,14cyclictest0-21swapper/009:02:590
433799145,4cyclictest0-21swapper/311:55:343
433699144,5cyclictest17918-21ssh11:40:042
4336991412,1cyclictest0-21swapper/208:53:082
433599145,4cyclictest0-21swapper/109:00:501
433599141,6cyclictest7537-21dump-pmu-power08:32:391
433599141,11cyclictest0-21swapper/112:42:391
433499144,5cyclictest0-21swapper/012:38:130
433499140,8cyclictest30322-21munin-run09:17:390
433799139,2cyclictest9292-21expr11:03:013
433799134,7cyclictest32113-21ssh10:23:283
433799133,5cyclictest0-21swapper/312:38:363
433799133,5cyclictest0-21swapper/311:41:553
433799133,5cyclictest0-21swapper/311:35:463
433799130,12cyclictest0-21swapper/309:17:583
433799130,12cyclictest0-21swapper/307:17:563
433699137,3cyclictest38350irq/34-enp3s0-t12:17:562
433699136,5cyclictest21632-21awk11:13:112
433699134,7cyclictest2364-21sshd12:28:112
433699134,4cyclictest0-21swapper/209:13:032
433699133,5cyclictest0-21swapper/211:05:122
433599139,2cyclictest0-21swapper/110:25:021
433599138,3cyclictest8375-21cpuspeed_turbos09:28:021
433599138,3cyclictest3435-21tr11:58:021
433599138,3cyclictest3340-21tr10:28:021
433599136,2cyclictest22-21ksoftirqd/107:58:181
433599134,4cyclictest0-21swapper/112:08:531
433599134,4cyclictest0-21swapper/111:00:471
433599134,4cyclictest0-21swapper/111:00:471
433599132,6cyclictest0-21swapper/109:43:041
433499137,4cyclictest26288-21grep10:48:140
433499135,6cyclictest0-21swapper/008:31:560
433499134,8cyclictest0-21swapper/011:52:410
433499134,8cyclictest0-21swapper/011:44:090
433499134,8cyclictest0-21swapper/011:41:110
433499134,8cyclictest0-21swapper/011:34:250
433499134,8cyclictest0-21swapper/010:41:350
433499134,8cyclictest0-21swapper/010:15:210
433499134,8cyclictest0-21swapper/009:59:090
433499134,8cyclictest0-21swapper/009:57:370
433499134,8cyclictest0-21swapper/009:18:230
433499134,8cyclictest0-21swapper/008:48:350
433499134,8cyclictest0-21swapper/008:39:270
433499134,8cyclictest0-21swapper/008:35:050
433499134,8cyclictest0-21swapper/007:35:130
433499134,8cyclictest0-21swapper/007:24:030
433499134,4cyclictest0-21swapper/009:28:480
433499134,4cyclictest0-21swapper/008:45:230
433499134,4cyclictest0-21swapper/008:08:310
265562130,1sleep20-21swapper/209:45:352
19552131,2sleep10-21swapper/112:28:071
433799129,2cyclictest549-21cron11:52:393
433799127,3cyclictest23514-21cpu12:17:583
433799127,3cyclictest20745-21grep07:48:023
433799125,5cyclictest1432-21fschecks_time09:53:013
433799124,5cyclictest38250irq/33-enp3s0-r12:07:573
433799123,8cyclictest0-21swapper/310:03:193
433799123,4cyclictest0-21swapper/312:33:303
433799122,5cyclictest0-21swapper/308:39:113
433799121,6cyclictest26983-21date08:02:403
433699126,4cyclictest563-21systemd-logind07:48:112
433699125,5cyclictest30463-21ls11:22:402
433699125,5cyclictest17251-21awk10:08:122
433699125,5cyclictest0-21swapper/210:59:412
433699125,5cyclictest0-21swapper/210:59:412
433699125,5cyclictest0-21swapper/209:53:492
433699124,6cyclictest0-21swapper/212:41:362
433699124,6cyclictest0-21swapper/212:04:382
433699124,6cyclictest0-21swapper/209:37:542
433699124,3cyclictest0-21swapper/210:27:392
433699124,3cyclictest0-21swapper/208:38:032
433699123,7cyclictest0-21swapper/208:34:502
433699123,4cyclictest0-21swapper/212:14:232
433699121,6cyclictest0-21swapper/210:44:232
433599128,3cyclictest22-21ksoftirqd/111:22:401
433599127,3cyclictest25355-21diskmemload09:24:551
433599126,4cyclictest24621-21ls12:18:071
433599126,1cyclictest22-21ksoftirqd/107:33:061
433599125,1cyclictest22-21ksoftirqd/107:48:041
433599124,5cyclictest0-21swapper/108:03:101
433599124,4cyclictest0-21swapper/109:41:181
433599124,3cyclictest0-21swapper/111:32:521
433599124,3cyclictest0-21swapper/110:05:461
433599124,2cyclictest22-21ksoftirqd/112:17:351
433599124,2cyclictest22-21ksoftirqd/111:25:251
433599124,2cyclictest22-21ksoftirqd/109:18:111
433599121,9cyclictest0-21swapper/107:38:121
433599121,7cyclictest0-21swapper/109:53:031
433599120,5cyclictest19689-21sendmail-msp11:42:391
433599120,1cyclictest141rcu_preempt08:08:111
433599120,11cyclictest0-21swapper/110:36:121
433599120,10cyclictest233-21systemd-journal07:27:391
433499127,3cyclictest24553-21idleruntime-cro07:57:390
433499126,4cyclictest6910-21wc07:17:450
433499126,4cyclictest3113-21cron08:22:390
433499126,4cyclictest233-21systemd-journal09:52:400
433499126,4cyclictest21501-21nfs4_client07:48:080
433499125,5cyclictest29109-21tune2fs12:23:020
433499125,5cyclictest0-21swapper/007:42:010
433499124,5cyclictest9394-21df11:03:010
433499124,5cyclictest820-21ssh10:25:150
433499124,5cyclictest3992-21ssh11:27:570
433499124,5cyclictest3341-21latency_hist08:22:390
433499124,4cyclictest0-21swapper/007:58:110
433499124,3cyclictest0-21swapper/012:17:410
433499123,8cyclictest0-21swapper/012:10:550
433499123,8cyclictest0-21swapper/012:00:070
433499123,8cyclictest0-21swapper/010:18:550
433499123,8cyclictest0-21swapper/010:02:550
433499123,8cyclictest0-21swapper/009:22:430
433499123,8cyclictest0-21swapper/009:10:050
433499123,8cyclictest0-21swapper/008:06:450
433499121,2cyclictest0-21swapper/012:34:330
433499120,10cyclictest27895-21awk09:47:400
433799118,2cyclictest567-21runrttasks11:22:583
433799116,3cyclictest29751-21turbostat.cron10:22:393
433799116,3cyclictest25355-21diskmemload11:31:443
433799115,5cyclictest21379-21kworker/u8:012:15:493
433799115,4cyclictest8637-21head08:33:033
433799115,4cyclictest6514-21head09:58:053
433799115,4cyclictest516-21dbus-daemon07:23:103
433799115,4cyclictest0-21swapper/311:22:123
433799114,5cyclictest4695-21ntpq10:58:123
433799114,5cyclictest4695-21ntpq10:58:123
433799114,5cyclictest0-21swapper/312:04:533
433799114,5cyclictest0-21swapper/309:09:423
433799114,5cyclictest0-21swapper/309:05:243
433799114,5cyclictest0-21swapper/308:43:113
433799114,5cyclictest0-21swapper/307:41:333
433799111,8cyclictest567-21runrttasks12:23:033
433799110,5cyclictest10135-21ssh09:28:443
433699115,4cyclictest9412-21head10:33:102
433699115,4cyclictest6371-21iwlist08:28:072
433699115,4cyclictest5774-21awk11:28:152
433699115,4cyclictest3197-21cut10:28:012
433699115,4cyclictest31571-21grep11:53:082
433699115,4cyclictest3111-21cron08:22:392
433699115,4cyclictest25613-21grep11:48:022
433699115,4cyclictest233-21systemd-journal07:57:402
433699115,4cyclictest0-21swapper/210:41:022
433699115,4cyclictest0-21swapper/207:47:122
433699114,6cyclictest0-21swapper/211:43:072
433699114,5cyclictest0-21swapper/212:08:022
433699114,5cyclictest0-21swapper/209:19:362
433699113,7cyclictest0-21swapper/207:19:122
433699113,6cyclictest13670-21ssh09:33:032
433699113,6cyclictest0-21swapper/209:49:372
433699113,6cyclictest0-21swapper/209:24:402
433699113,3cyclictest0-21swapper/208:23:042
433699113,2cyclictest0-21swapper/212:25:232
433699113,2cyclictest0-21swapper/211:08:382
433699113,2cyclictest0-21swapper/209:28:312
433699110,6cyclictest9731-21ssh11:33:042
433699110,5cyclictest28937-21sshd08:07:302
433699110,5cyclictest23273-21ssh10:15:122
433599117,2cyclictest25355-21diskmemload09:12:411
433599117,2cyclictest22-21ksoftirqd/110:42:521
433599117,2cyclictest22-21ksoftirqd/110:18:021
433599117,2cyclictest22-21ksoftirqd/108:48:061
433599117,2cyclictest22-21ksoftirqd/108:33:011
433599117,2cyclictest22-21ksoftirqd/108:18:081
433599117,2cyclictest22-21ksoftirqd/107:43:051
433599116,3cyclictest13091-21aten2.4_r8power09:33:001
433599115,4cyclictest21212-21sh11:13:081
433599115,4cyclictest17288-21awk10:08:131
433599115,4cyclictest1-21systemd07:17:441
433599115,4cyclictest0-21swapper/108:44:081
433599114,5cyclictest233-21systemd-journal10:15:581
433599114,5cyclictest19431-21cat11:12:401
433599113,3cyclictest0-21swapper/112:02:531
433599113,3cyclictest0-21swapper/111:43:051
433599113,3cyclictest0-21swapper/111:05:031
433599113,3cyclictest0-21swapper/109:10:511
433599112,4cyclictest22-21ksoftirqd/107:57:391
433499116,3cyclictest15377-21sh10:07:410
433499115,4cyclictest19927-21if_eno110:43:050
433499114,5cyclictest18231-21apt-get07:42:590
433499114,5cyclictest0-21swapper/012:29:190
433499114,5cyclictest0-21swapper/011:26:430
433499114,5cyclictest0-21swapper/011:17:550
433499114,5cyclictest0-21swapper/011:13:390
433499113,8cyclictest0-21swapper/010:58:550
433499113,8cyclictest0-21swapper/010:58:550
433499113,7cyclictest16465-21sh11:08:450
433799106,2cyclictest28374-21basename09:48:003
433799105,4cyclictest20822-21awk10:43:133
433799105,4cyclictest0-21swapper/308:24:403
433799105,4cyclictest0-21swapper/308:09:313
433799105,3cyclictest32054-21grep08:13:043
433799104,5cyclictest3810-21sed11:58:063
433799104,5cyclictest0-21swapper/308:17:433
433799104,5cyclictest0-21swapper/307:53:013
433799104,5cyclictest0-21swapper/307:33:043
433799104,5cyclictest0-21swapper/307:30:243
433799104,4cyclictest8982-21if_err_eno110:33:053
433799104,4cyclictest5773-21cpu08:28:033
433799104,4cyclictest14168-21grep10:38:023
433799104,4cyclictest0-21swapper/311:12:423
433799104,4cyclictest0-21swapper/309:44:163
433799104,4cyclictest0-21swapper/308:57:563
433799103,5cyclictest1272-21aten2.4-expect12:28:023
433799102,4cyclictest0-21swapper/308:03:053
433799101,8cyclictest14351-21/usr/sbin/munin11:08:103
433799101,4cyclictest12854-21ssh09:32:453
433799100,4cyclictest20867-21idleruntime11:43:043
433799100,4cyclictest17454-21ssh10:08:323
433699106,2cyclictest567-21runrttasks09:57:512
433699106,2cyclictest25791-21missed_timers10:48:092
433699106,2cyclictest20154-21pmu-power08:58:102
433699106,2cyclictest11373-21latency_hist07:27:392
433699104,5cyclictest0-21swapper/207:38:332
433699104,4cyclictest24046-21sed09:08:022
433699104,4cyclictest0-21swapper/212:33:052
433699102,3cyclictest0-21swapper/207:53:022
433699100,8cyclictest30431-21cpuspeed_turbos10:53:022
433699100,5cyclictest32012-21memory11:23:062
433699100,4cyclictest14586-21/usr/sbin/munin08:48:072
433599107,2cyclictest22-21ksoftirqd/111:47:401
433599107,2cyclictest22-21ksoftirqd/109:48:131
433599107,2cyclictest22-21ksoftirqd/108:23:021
433599107,1cyclictest22-21ksoftirqd/108:38:081
433599105,3cyclictest567-21runrttasks09:58:191
433599104,5cyclictest0-21swapper/111:29:451
433599104,5cyclictest0-21swapper/108:12:581
433599104,4cyclictest31451-21pmu-power10:53:101
433599104,4cyclictest30640-21cpu11:53:011
433599103,5cyclictest22691-21grep09:03:131
433599102,4cyclictest0-21swapper/107:28:041
433599101,8cyclictest211rcuc/107:13:041
433499105,3cyclictest12115-21fschecks_count07:28:020
143892100,0sleep20-21swapper/208:47:392
43379996,2cyclictest15409-21if_err_eno108:48:043
43379990,5cyclictest20142-21ssh10:12:453
43369994,3cyclictest21241-21telnet09:02:592
43369993,4cyclictest579-21snmpd07:27:452
43369991,2cyclictest0-21swapper/207:32:582
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional