You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-06-03 - 06:30

x86 Intel Core i3-2310E @2100 MHz, Linux 5.10.47-rt46 (Profile)

Latency plot of system in rack #8, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by a total of 2 SMIs that occured during the measurement.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot2.osadl.org (updated Sat Jun 03, 2023 00:43:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
970299143140,2cyclictest0-21swapper/019:10:270
970399121112,8cyclictest0-21swapper/119:50:331
970599108106,1cyclictest0-21swapper/319:10:273
127572990,0sleep30-21swapper/300:38:413
106442940,0sleep30-21swapper/322:57:253
9702997068,1cyclictest0-21swapper/019:50:330
9704996967,1cyclictest0-21swapper/219:10:272
9705993734,2cyclictest28695-21strings19:50:333
9703993720,16cyclictest0-21swapper/122:05:271
970299310,4cyclictest4611-21sh21:48:220
69522310,0chrt0-21swapper/122:21:561
9705992826,1cyclictest0-21swapper/323:45:263
176942270,0sleep20-21swapper/223:35:362
970299244,14cyclictest9148-21ssh23:59:530
20952240,2sleep32093-21ls21:45:343
970399220,21cyclictest0-21swapper/122:10:281
970299223,12cyclictest567-21runrttasks00:22:470
970299220,1cyclictest0-21swapper/021:20:260
310162220,0sleep10-21swapper/121:10:331
161612220,1sleep016157-21cron23:35:090
970299216,8cyclictest14472-21awk19:20:090
970399190,18cyclictest0-21swapper/123:45:261
970299190,1cyclictest0-21swapper/020:25:390
970399180,1cyclictest0-21swapper/119:35:201
970299181,9cyclictest10983-21basename21:55:090
970299173,10cyclictest0-21swapper/023:06:410
970299170,9cyclictest5910-21awk23:25:090
970299168,7cyclictest12-21ksoftirqd/022:52:410
970299164,9cyclictest29579-21diskmemload00:29:210
970299163,9cyclictest0-21swapper/022:57:470
970299163,8cyclictest0-21swapper/021:12:230
970399150,13cyclictest15984-21grep22:30:351
970299158,6cyclictest0-21swapper/020:56:290
970299158,6cyclictest0-21swapper/020:35:150
970299157,7cyclictest0-21swapper/022:29:570
970299157,7cyclictest0-21swapper/020:30:170
970299155,9cyclictest29579-21diskmemload21:18:250
970299153,8cyclictest27092-21ssh22:41:210
970299150,11cyclictest31748-21sh21:43:090
970599144,5cyclictest645-21ssh23:20:023
970499144,6cyclictest0-21swapper/222:37:132
970499144,5cyclictest0-21swapper/200:21:282
970399148,4cyclictest22-21ksoftirqd/123:00:091
970399145,4cyclictest0-21swapper/123:38:361
970399141,9cyclictest4876-21taskset00:30:261
970399141,11cyclictest0-21swapper/100:20:261
970299147,6cyclictest0-21swapper/020:15:450
970299147,3cyclictest0-21swapper/021:39:090
970299147,1cyclictest0-21swapper/022:33:110
970299146,7cyclictest0-21swapper/023:40:290
970299146,7cyclictest0-21swapper/021:31:470
970299146,7cyclictest0-21swapper/000:35:130
970299146,7cyclictest0-21swapper/000:33:450
970299146,4cyclictest0-21swapper/023:35:410
970299145,6cyclictest0-21swapper/019:23:230
970299144,9cyclictest0-21swapper/022:47:410
970299144,9cyclictest0-21swapper/019:28:470
970299144,5cyclictest29579-21diskmemload23:26:570
970299140,11cyclictest16915-21ssh00:07:330
970599135,6cyclictest0-21swapper/321:26:043
970599135,6cyclictest0-21swapper/321:26:043
970599134,4cyclictest0-21swapper/320:19:563
970599134,4cyclictest0-21swapper/300:15:323
970599133,5cyclictest0-21swapper/321:56:143
970499136,5cyclictest12075-21grep21:55:342
970499135,7cyclictest0-21swapper/220:28:142
970499134,4cyclictest0-21swapper/220:54:362
970299138,4cyclictest0-21swapper/019:49:190
970299137,4cyclictest1-21systemd20:01:010
970299137,3cyclictest0-21swapper/000:10:430
970299137,2cyclictest0-21swapper/019:44:030
970299137,2cyclictest0-21swapper/019:44:030
970299136,6cyclictest0-21swapper/019:33:130
970299136,5cyclictest626-21gdbus22:00:090
970299136,4cyclictest29579-21diskmemload00:04:030
970299136,3cyclictest0-21swapper/023:45:210
970299136,3cyclictest0-21swapper/019:36:050
970299135,7cyclictest0-21swapper/022:36:390
970299135,7cyclictest0-21swapper/022:20:470
970299135,7cyclictest0-21swapper/020:10:510
970299134,8cyclictest0-21swapper/000:15:210
970299133,8cyclictest0-21swapper/022:08:290
970299133,7cyclictest0-21swapper/020:50:170
970299131,9cyclictest2670-21latency20:05:370
970299130,9cyclictest22806-21apt-get23:10:110
970299130,9cyclictest13053-21aten2_r8power_v23:00:270
970299130,9cyclictest0-21swapper/022:15:390
970299130,5cyclictest18792-21idleruntime-cro20:45:090
970599126,4cyclictest21363-21basename23:40:103
970599126,4cyclictest19605-21head19:30:253
970599126,4cyclictest14429-21cron20:35:093
970599125,5cyclictest324262sleep321:44:113
970599124,7cyclictest16145-21ssh23:35:083
970599124,7cyclictest10945-21ssh21:55:093
970599124,7cyclictest0-21swapper/322:16:423
970599124,7cyclictest0-21swapper/321:37:463
970599124,3cyclictest0-21swapper/300:34:523
970599123,6cyclictest0-21swapper/321:12:073
970599123,4cyclictest6684-21ssh22:21:333
970599123,4cyclictest0-21swapper/320:03:203
970599123,4cyclictest0-21swapper/300:03:153
970599121,6cyclictest0-21swapper/322:27:063
970499126,4cyclictest24746-21sed23:10:392
970499125,5cyclictest22637-21grep19:35:332
970499125,5cyclictest0-21swapper/221:50:302
970499124,7cyclictest0-21swapper/222:07:122
970499124,7cyclictest0-21swapper/220:32:332
970499124,7cyclictest0-21swapper/200:13:122
970499124,6cyclictest0-21swapper/223:34:272
970499124,2cyclictest0-21swapper/223:51:372
970499124,2cyclictest0-21swapper/222:57:092
970499123,8cyclictest0-21swapper/223:57:512
970499122,5cyclictest0-21swapper/221:17:402
970499121,6cyclictest27505-21head23:45:302
970399127,3cyclictest12690-21awk23:30:361
970399126,4cyclictest2354-21ntpq23:20:341
970399125,6cyclictest0-21swapper/121:46:021
970399125,5cyclictest27425-21idleruntime-cro21:05:091
970399125,5cyclictest18779-21perf20:45:091
970399124,3cyclictest0-21swapper/119:12:301
970399123,4cyclictest0-21swapper/123:55:451
970399121,8cyclictest0-21swapper/123:50:211
970299128,3cyclictest0-21swapper/022:02:170
970299127,4cyclictest0-21swapper/023:19:250
970299127,4cyclictest0-21swapper/020:46:390
970299124,4cyclictest0-21swapper/021:02:010
970299124,3cyclictest0-21swapper/021:25:270
970299124,3cyclictest0-21swapper/021:25:270
970299123,6cyclictest0-21swapper/021:06:070
970299122,9cyclictest0-21swapper/022:12:530
970299122,6cyclictest3490-21ssh23:54:010
970299121,9cyclictest0-21swapper/020:22:130
970599116,3cyclictest9355-21perf00:00:093
970599116,3cyclictest567-21runrttasks00:10:273
970599116,3cyclictest4475-21sh00:30:093
970599116,3cyclictest38250irq/33-enp3s0-r22:45:313
970599116,3cyclictest18504-21sh23:05:283
970599116,3cyclictest17134-21grep20:40:263
970599115,5cyclictest0-21swapper/320:48:423
970599115,4cyclictest25229-21tr22:40:273
970599115,4cyclictest233-21systemd-journal20:10:093
970599115,4cyclictest20966-21tr22:35:333
970599114,5cyclictest516-21dbus-daemon20:25:393
970599114,5cyclictest27076-21tune2fs22:10:323
970599113,3cyclictest0-21swapper/319:55:253
970599111,8cyclictest0-21swapper/319:15:263
970599110,5cyclictest21724-21grep22:05:293
970499117,3cyclictest21165-21sshd21:32:382
970499117,3cyclictest0-21swapper/220:49:422
970499116,4cyclictest24602-21systemctl19:40:362
970499116,4cyclictest24602-21systemctl19:40:362
970499116,4cyclictest17911-21awk19:25:342
970499116,3cyclictest2343-21grep20:05:342
970499116,3cyclictest15058-21sh23:01:202
970499115,4cyclictest4000-21tr22:20:092
970499115,4cyclictest29808-21sed21:10:092
970499115,4cyclictest28728-21ntp_kernel_pll_19:50:342
970499115,4cyclictest233-21systemd-journal21:45:092
970499115,4cyclictest1474-21cron20:05:092
970499115,4cyclictest14375-21tr00:05:272
970499114,6cyclictest0-21swapper/221:00:382
970499114,5cyclictest7973-21readlink20:20:092
970499114,5cyclictest6423-21cut23:25:282
970499114,5cyclictest0-21swapper/223:44:162
970499114,1cyclictest0-21swapper/200:27:052
970499113,7cyclictest0-21swapper/219:48:162
970499113,7cyclictest0-21swapper/200:38:402
970499113,4cyclictest0-21swapper/221:21:372
970499113,2cyclictest0-21swapper/200:04:052
970499112,4cyclictest0-21swapper/223:07:472
970499111,9cyclictest0-21swapper/221:29:362
970499111,9cyclictest0-21swapper/221:29:362
970499111,8cyclictest30329-21cpuspeed_turbos22:45:292
970399118,2cyclictest0-21swapper/121:40:351
970399117,2cyclictest13147-21grep19:15:261
970399117,2cyclictest10019-21cpuspeed_turbos00:00:271
970399116,3cyclictest29579-21diskmemload21:35:251
970399116,3cyclictest200342sleep122:35:271
970399115,4cyclictest29579-21diskmemload21:19:041
970399115,4cyclictest23928-21head20:55:301
970399115,4cyclictest233-21systemd-journal22:17:331
970399115,4cyclictest19206-21grep00:10:261
970399115,4cyclictest12692-21awk21:55:411
970399115,4cyclictest0-21swapper/120:45:311
970399114,6cyclictest0-21swapper/100:07:481
970399114,4cyclictest9625-21ssh23:28:051
970399112,4cyclictest391-21ssh23:19:411
970399111,5cyclictest0-21swapper/121:07:191
970399111,5cyclictest0-21swapper/100:20:011
970299116,4cyclictest0-21swapper/019:55:450
970599108,1cyclictest0-21swapper/321:32:063
970599106,2cyclictest16836-21sh23:03:583
970599105,3cyclictest17044-21cpuspeed_turbos19:25:273
970599105,3cyclictest0-21swapper/320:50:153
970599104,5cyclictest579-21snmpd20:22:053
970599104,5cyclictest0-21swapper/321:01:093
970599104,5cyclictest0-21swapper/320:59:003
970599104,5cyclictest0-21swapper/319:45:073
970599104,5cyclictest0-21swapper/319:45:073
970599104,4cyclictest516-21dbus-daemon00:20:373
970599104,4cyclictest4494-21head20:10:243
970599104,4cyclictest3601-21if_err_enp5s021:15:363
970599104,4cyclictest26625-21open_inodes19:45:373
970599104,4cyclictest22362-21processes19:35:303
970599104,4cyclictest15347-21head20:35:403
970599104,4cyclictest15242-21head22:30:293
970599103,5cyclictest8796-21latency21:20:353
970599103,5cyclictest17418-21irqstats22:00:373
970599103,1cyclictest0-21swapper/322:50:263
970599101,4cyclictest0-21swapper/323:10:323
970599100,4cyclictest3600-21ssh23:21:443
970599100,4cyclictest28226-21grep21:05:253
970599100,4cyclictest21896-21grep23:40:263
970499107,2cyclictest11870-21munin-node19:15:132
970499106,3cyclictest14375-21latency_hist22:30:092
970499106,2cyclictest5788-21latency_hist20:15:102
970499106,2cyclictest25771-21if_enp5s022:40:302
970499105,4cyclictest9464-21sendmail_mailqu20:20:402
970499105,4cyclictest626-21gdbus21:45:392
970499105,3cyclictest29796-21/usr/sbin/munin19:55:272
970499105,3cyclictest23609-21grep20:55:282
970499105,3cyclictest19634-21grep19:30:252
970499104,5cyclictest27183-21ssh00:18:492
970499104,5cyclictest0-21swapper/222:20:122
970499104,4cyclictest5808-21sort00:30:322
970499104,4cyclictest30059-21wget21:10:262
970499104,4cyclictest29077-21grep23:15:302
970499104,4cyclictest27141-21gltestperf22:10:332
970499104,4cyclictest18309-21grep20:40:392
970499104,4cyclictest16620-21perf20:40:092
970499104,4cyclictest0-21swapper/223:23:262
970499102,6cyclictest0-21swapper/222:52:302
970499101,7cyclictest0-21swapper/221:35:252
970499100,5cyclictest0-21swapper/219:20:362
970499100,4cyclictest14625-21/usr/sbin/munin22:30:342
970399108,1cyclictest0-21swapper/119:33:051
970399107,2cyclictest29579-21diskmemload23:42:031
970399106,2cyclictest29579-21diskmemload22:53:181
970399106,2cyclictest29579-21diskmemload22:46:111
970399105,4cyclictest14490-21wc21:25:391
970399105,4cyclictest14490-21wc21:25:391
970399105,4cyclictest0-21swapper/120:38:271
970399105,3cyclictest7150-21open_files20:15:471
970399105,3cyclictest14247-21/usr/sbin/munin23:00:361
970399105,3cyclictest12525-21acpi20:30:221
970399105,3cyclictest0-21swapper/123:09:381
970399105,3cyclictest0-21swapper/120:15:091
970399104,4cyclictest9524-21cut00:35:241
970399104,4cyclictest905-21fschecks_count00:25:311
970399104,4cyclictest32554-21grep20:00:251
970399104,4cyclictest18080-21grep22:00:441
970399104,4cyclictest14713-21apt19:20:261
970399103,5cyclictest579-21snmpd22:44:131
970399103,5cyclictest30361-21tune2fs19:55:271
970399103,5cyclictest19533-21systemctl21:30:361
970399103,5cyclictest0-21swapper/120:07:291
970399102,6cyclictest9541-21smartctl20:20:411
970399101,3cyclictest0-21swapper/119:45:271
97059996,2cyclictest655-21ntp_offset23:50:293
97059995,2cyclictest14789-21sed00:05:303
97059992,5cyclictest579-21snmpd19:20:093
97059991,6cyclictest6615-21cpuspeed_turbos23:25:293
97049993,4cyclictest16820-21cstates22:00:312
97039996,2cyclictest6931-21grep21:50:291
97039996,2cyclictest29579-21diskmemload21:20:251
97039994,3cyclictest23500-21grep23:10:281
97039993,5cyclictest0-21swapper/119:40:311
97039993,5cyclictest0-21swapper/119:40:311
97039993,4cyclictest579-21snmpd20:25:261
97039993,4cyclictest579-21snmpd19:25:311
97039992,5cyclictest0-21swapper/120:50:331
97039990,1cyclictest0-21swapper/122:25:251
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional