You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-12-04 - 08:33
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by a total of 2 SMIs that occured during the measurement.
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack8slot2.osadl.org (updated Mon Dec 04, 2023 00:43:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
161799148139,8cyclictest0-21swapper/121:27:371
161999125122,1cyclictest0-21swapper/319:12:573
161899125123,1cyclictest0-21swapper/219:12:572
1616996259,2cyclictest0-21swapper/021:27:370
1617996052,7cyclictest0-21swapper/119:12:571
111302290,0sleep00-21swapper/021:33:030
238362280,2sleep20-21swapper/222:22:512
270982260,1sleep30-21swapper/322:58:073
119962260,1sleep10-21swapper/100:25:061
1616992522,2cyclictest0-21swapper/023:02:530
135892250,0sleep10-21swapper/123:49:271
235752240,0sleep10-21swapper/100:37:571
187492220,1sleep20-21swapper/222:16:462
187492220,1sleep20-21swapper/222:16:462
1617992220,1cyclictest0-21swapper/122:12:501
1617992220,1cyclictest0-21swapper/122:12:501
161699221,20cyclictest0-21swapper/020:37:540
161699220,1cyclictest0-21swapper/020:22:520
1616992119,1cyclictest0-21swapper/023:22:560
136942210,0sleep00-21swapper/022:11:510
161799190,1cyclictest0-21swapper/119:37:551
126242180,0sleep20-21swapper/219:33:012
1618991711,5cyclictest0-21swapper/223:02:532
161699171,1cyclictest0-21swapper/019:22:520
161699165,6cyclictest0-21swapper/023:38:320
161699162,7cyclictest996-21awk22:32:350
143972160,1sleep00-21swapper/023:18:000
161999151,6cyclictest22850-21diskmemload21:16:073
161999151,1cyclictest0-21swapper/319:37:553
161699154,6cyclictest15867-21ssh23:52:350
161699150,8cyclictest5385-21munin-run22:02:350
161999148,4cyclictest19222-21grep19:48:023
161999148,4cyclictest1898-21ssh23:05:353
161899147,5cyclictest233-21systemd-journal19:38:062
161899147,4cyclictest0-21swapper/222:11:112
161899144,5cyclictest0-21swapper/222:52:572
161699146,3cyclictest0-21swapper/021:47:500
161699143,6cyclictest0-21swapper/000:14:540
161699143,3cyclictest0-21swapper/000:01:330
161699141,1cyclictest0-21swapper/000:37:570
1616991411,2cyclictest131rcuc/022:45:250
161999138,3cyclictest29977-21grep21:52:543
161999137,4cyclictest25068-21grep23:28:013
161999134,4cyclictest0-21swapper/321:51:083
161999132,2cyclictest0-21swapper/321:07:583
161999131,10cyclictest16545-21awk21:38:083
161899138,3cyclictest21138-21dump-pmu-power23:57:352
161899135,7cyclictest0-21swapper/221:39:222
161899134,8cyclictest0-21swapper/200:28:462
161899134,4cyclictest0-21swapper/220:34:442
161899133,5cyclictest1021-21ssh21:22:462
161899133,5cyclictest0-21swapper/200:24:212
161899130,10cyclictest24526-21ssh23:27:562
161799138,3cyclictest18449-21tr19:47:541
161799134,8cyclictest0-21swapper/123:32:111
161799134,8cyclictest0-21swapper/122:39:031
161799134,8cyclictest0-21swapper/121:34:341
161799134,4cyclictest0-21swapper/122:30:091
161699138,3cyclictest18316-21munin-plugin-st00:32:350
161699133,5cyclictest0-21swapper/020:28:010
161699133,3cyclictest12-21ksoftirqd/021:41:320
161699132,2cyclictest12-21ksoftirqd/021:44:340
161699132,2cyclictest12-21ksoftirqd/000:33:230
1616991310,2cyclictest131rcuc/000:09:380
249032120,0chrt0-21swapper/122:57:091
161999129,1cyclictest4290-21apt-get21:27:373
161999127,4cyclictest233-21systemd-journal23:57:303
161999126,4cyclictest14634-21aten2.4_r8power22:12:513
161999126,4cyclictest14634-21aten2.4_r8power22:12:513
161999126,4cyclictest1332-21cat20:22:543
161999125,6cyclictest0-21swapper/320:05:133
161999124,6cyclictest0-21swapper/323:34:323
161999124,3cyclictest0-21swapper/300:38:403
161999123,6cyclictest0-21swapper/320:22:353
161999122,5cyclictest0-21swapper/300:33:063
161999121,8cyclictest27618-21smartctl20:07:583
161999121,6cyclictest0-21swapper/319:33:123
161999121,6cyclictest0-21swapper/300:03:243
161899127,3cyclictest7778-21grep23:42:582
161899126,4cyclictest8202-21tr19:23:022
161899124,6cyclictest0-21swapper/223:13:082
161899124,6cyclictest0-21swapper/222:46:002
161899124,6cyclictest0-21swapper/221:12:392
161899123,7cyclictest14604-21grep20:52:542
161899123,4cyclictest31207-21sensors_temp23:33:202
161899123,2cyclictest141rcu_preempt22:21:432
161899122,5cyclictest0-21swapper/219:52:192
161899122,5cyclictest0-21swapper/219:42:592
161899122,5cyclictest0-21swapper/200:17:332
1618991210,1cyclictest0-21swapper/221:27:372
161799126,4cyclictest3072-21grep22:33:101
161799125,5cyclictest233-21systemd-journal23:07:351
161799125,5cyclictest233-21systemd-journal22:07:351
161799124,7cyclictest0-21swapper/122:01:141
161799123,6cyclictest0-21swapper/119:17:361
161799123,5cyclictest0-21swapper/100:28:431
161799123,4cyclictest12977-21ssh23:16:401
161799122,6cyclictest21352-21ssh22:20:001
161799122,5cyclictest0-21swapper/123:35:051
161799121,6cyclictest1976-21ssh21:24:101
161799121,6cyclictest0-21swapper/121:45:531
161699129,2cyclictest131rcuc/023:33:160
161699129,2cyclictest131rcuc/023:29:310
161699129,2cyclictest131rcuc/023:09:490
161699129,2cyclictest131rcuc/020:47:470
161699126,3cyclictest0-21swapper/019:12:420
161699125,5cyclictest14606-21tr20:52:540
161699124,3cyclictest0-21swapper/022:57:490
161699124,3cyclictest0-21swapper/022:47:420
161699124,3cyclictest0-21swapper/021:09:180
161699124,3cyclictest0-21swapper/020:17:410
161699124,3cyclictest0-21swapper/000:24:330
161699123,6cyclictest131rcuc/022:14:060
161699123,6cyclictest131rcuc/022:14:060
161699123,6cyclictest12-21ksoftirqd/023:13:340
161699123,6cyclictest12-21ksoftirqd/020:17:300
161699123,5cyclictest12-21ksoftirqd/023:56:200
161699123,5cyclictest12-21ksoftirqd/000:05:370
161699122,4cyclictest131rcuc/000:17:570
161699122,2cyclictest8629-21strings23:43:080
161699122,2cyclictest12-21ksoftirqd/022:53:300
161699122,2cyclictest12-21ksoftirqd/022:27:250
161699122,2cyclictest12-21ksoftirqd/022:19:090
161699122,2cyclictest12-21ksoftirqd/021:16:250
161699121,3cyclictest12-21ksoftirqd/021:25:150
1616991210,1cyclictest12-21ksoftirqd/022:32:550
182852110,1sleep30-21swapper/300:32:353
161999117,2cyclictest9646-21latency_hist20:42:353
161999117,2cyclictest19383-21cut21:03:013
161999116,4cyclictest7212-21basename22:03:003
161999116,3cyclictest5713-21sh23:40:433
161999116,3cyclictest567-21runrttasks22:18:393
161999116,3cyclictest5136-21rm00:17:153
161999116,3cyclictest20496-21aten2.4_r8power22:52:523
161999116,3cyclictest18720-21sh23:22:323
161999116,3cyclictest10463-21ntpq19:28:043
161999114,6cyclictest0-21swapper/322:34:273
161999114,5cyclictest579-21snmpd00:25:573
161999114,5cyclictest11704-21ssh23:14:463
161999113,6cyclictest0-21swapper/322:12:113
161999113,3cyclictest0-21swapper/323:47:533
161999113,3cyclictest0-21swapper/321:46:233
161999113,3cyclictest0-21swapper/319:58:553
161999112,4cyclictest0-21swapper/321:58:413
161999111,5cyclictest0-21swapper/323:10:553
161999110,9cyclictest22850-21diskmemload21:23:023
161999110,9cyclictest15416-21ntp_offset20:53:023
161899117,3cyclictest3286-21/usr/sbin/munin20:28:062
161899117,3cyclictest30492-21sh21:52:582
161899117,3cyclictest0-21swapper/221:03:002
161899116,4cyclictest29338-21awk20:12:562
161899116,3cyclictest21881-21missed_timers21:08:002
161899115,5cyclictest26776-21missed_timers22:58:032
161899115,4cyclictest11229-21systemctl20:43:042
161899115,4cyclictest10787-21sed21:32:592
161899114,6cyclictest0-21swapper/223:47:382
161899114,5cyclictest5393-21basename22:02:352
161899114,5cyclictest0-21swapper/223:40:412
161899114,4cyclictest0-21swapper/200:18:002
161899114,1cyclictest0-21swapper/200:10:322
161899113,6cyclictest0-21swapper/200:37:402
161899113,3cyclictest2166-21which22:33:002
161899113,3cyclictest0-21swapper/222:02:542
161899113,2cyclictest0-21swapper/223:25:082
161899113,2cyclictest0-21swapper/223:08:182
161899113,1cyclictest0-21swapper/221:52:182
161899112,5cyclictest0-21swapper/222:38:062
161799118,2cyclictest5858-21aten2.4_r8power00:17:521
161799116,4cyclictest2174-21tr20:23:011
161799115,5cyclictest0-21swapper/120:12:591
161799115,4cyclictest626-21gdbus20:53:051
161799115,4cyclictest1407-21ssh21:57:101
161799115,2cyclictest5356-21perf00:17:341
161799114,5cyclictest8384-21ssh23:43:051
161799114,5cyclictest0-21swapper/122:59:251
161799114,5cyclictest0-21swapper/122:51:101
161799114,5cyclictest0-21swapper/120:47:591
161799114,5cyclictest0-21swapper/100:07:001
161799114,4cyclictest3129-21ssh23:37:561
161799114,4cyclictest0-21swapper/121:14:521
161799114,4cyclictest0-21swapper/119:43:401
161799113,7cyclictest0-21swapper/120:30:531
161799113,5cyclictest0-21swapper/121:37:521
161799111,5cyclictest26376-21ssh22:24:451
161699119,1cyclictest131rcuc/019:44:470
161699118,2cyclictest131rcuc/022:03:050
161699118,2cyclictest131rcuc/019:56:530
161699118,2cyclictest131rcuc/019:38:090
161699117,2cyclictest6172-21cut20:33:020
161699116,3cyclictest567-21runrttasks19:28:060
161699115,4cyclictest7288-21grep22:38:020
161699115,4cyclictest29036-21head21:17:550
161699115,4cyclictest19794-21awk21:03:050
161699113,5cyclictest0-21swapper/020:44:540
161699113,3cyclictest0-21swapper/020:06:280
161699112,7cyclictest6698-21awk19:22:350
161699112,6cyclictest12-21ksoftirqd/020:58:590
161699112,2cyclictest12-21ksoftirqd/020:08:160
161699111,3cyclictest12-21ksoftirqd/021:52:420
161699110,7cyclictest0-21swapper/020:00:070
161699110,2cyclictest13162-21seq19:33:480
161999107,2cyclictest38250irq/33-enp3s0-r21:17:573
161999107,2cyclictest17061-21ntp_states19:43:033
161999106,3cyclictest34-21ksoftirqd/319:57:343
161999106,2cyclictest28458-21sh22:27:373
161999105,4cyclictest579-21snmpd22:49:063
161999105,4cyclictest17394-21cut20:58:003
161999105,4cyclictest12797-21cat22:43:093
161999105,3cyclictest9855-21sh23:44:153
161999105,3cyclictest5765-21aten2.4_r8power00:17:513
161999105,3cyclictest22025-21rm23:24:453
161999105,3cyclictest11043-21rm22:42:233
161999104,4cyclictest7075-21apt-key19:22:363
161999104,4cyclictest4822-21cut19:17:543
161999104,4cyclictest4595-21sendmail_mailst20:28:043
161999104,4cyclictest29100-21seq20:12:473
161999104,4cyclictest12687-21grep20:47:573
161999103,5cyclictest10130-21sort20:42:543
161999102,6cyclictest29965-21apt-get00:07:513
161999102,3cyclictest0-21swapper/300:00:333
161999102,1cyclictest141rcu_preempt22:22:523
161999101,5cyclictest12135-21ssh21:33:393
161999100,5cyclictest0-21swapper/320:33:043
161899107,2cyclictest27805-21interrupts20:08:012
161899105,4cyclictest17897-21wc20:58:052
161899105,3cyclictest32230-21latency20:18:012
161899105,3cyclictest24473-21latency_hist20:02:352
161899105,3cyclictest20241-21sh21:42:382
161899105,3cyclictest14181-21latency_hist20:52:352
161899104,4cyclictest0-21swapper/220:40:242
161899103,6cyclictest0-21swapper/221:20:552
161899103,5cyclictest233-21systemd-journal20:03:102
161899103,5cyclictest18738-21acpi00:32:572
161899103,1cyclictest0-21swapper/222:48:522
161899102,3cyclictest28-21ksoftirqd/200:04:152
161899101,5cyclictest28842-21ssh22:27:542
161899101,1cyclictest0-21swapper/219:52:552
161899100,4cyclictest22653-21/usr/sbin/munin23:58:122
161899100,4cyclictest15091-21sshd23:18:092
161799107,2cyclictest4440-21hddtemp_smartct23:08:021
161799107,2cyclictest28338-21/usr/sbin/munin21:17:591
161799106,2cyclictest20593-21sh23:56:481
161799105,4cyclictest0-21swapper/119:34:451
161799105,3cyclictest8583-21unixbench-2d19:23:061
161799105,3cyclictest31644-21tr20:17:551
161799105,3cyclictest25254-21fschecks_count20:02:581
161799105,3cyclictest20921-21gltestperf19:53:011
161799105,3cyclictest10519-21pmu-power19:28:051
161799104,5cyclictest579-21snmpd23:23:461
161799104,5cyclictest0-21swapper/121:48:081
161799104,5cyclictest0-21swapper/120:43:511
161799104,5cyclictest0-21swapper/120:37:531
161799104,5cyclictest0-21swapper/120:33:041
161799104,5cyclictest0-21swapper/100:33:101
161799104,4cyclictest579-21snmpd22:44:361
161799104,4cyclictest23625-21ntpq19:58:021
161799103,5cyclictest0-21swapper/123:20:371
161799103,5cyclictest0-21swapper/122:09:171
161799102,4cyclictest30954-21ssh00:08:001
161799102,3cyclictest0-21swapper/120:07:591
161799101,7cyclictest0-21swapper/100:02:351
161699100,3cyclictest19695-21runrttasks19:48:060
16189993,4cyclictest3813-21gpgv19:17:362
16189991,6cyclictest1387-21cpuspeed_turbos20:22:542
16189990,7cyclictest9646-21cpuspeed_turbos19:27:552
16179993,5cyclictest0-21swapper/121:03:331
16179993,4cyclictest16573-21aten2.4_r8power20:57:531
16179993,4cyclictest0-21swapper/121:10:271
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional