You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-06-08 - 21:21

x86 Intel Core i3-8145UE @2200 MHz, Linux 5.10.27-rt36 (Profile)

Latency plot of system in rack #e, slot #5
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot5.osadl.org (updated Thu Jun 08, 2023 12:44:20)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
13981993226,2cyclictest5711-21diskmemload09:14:411
1398199320,31cyclictest5711-21diskmemload12:27:201
1398199320,31cyclictest0-21swapper/111:03:231
13982993128,3cyclictest0-21swapper/210:59:042
1398299310,30cyclictest28753-21cron11:40:002
13981993129,2cyclictest0-21swapper/111:25:141
13981993128,2cyclictest16908-21systemd-journal09:05:011
13981993125,5cyclictest16908-21systemd-journal12:05:011
1398199310,31cyclictest0-21swapper/110:43:341
1398199310,31cyclictest0-21swapper/109:39:401
1398199310,30cyclictest25401-21fw_packets10:00:251
1398199310,28cyclictest5711-21diskmemload10:19:541
1398199310,28cyclictest0-21swapper/111:55:201
1398199310,0cyclictest0-21swapper/112:35:231
1398199310,0cyclictest0-21swapper/111:21:301
1398199310,0cyclictest0-21swapper/110:26:471
1398199310,0cyclictest0-21swapper/110:23:091
13976993129,1cyclictest16908-21systemd-journal08:35:000
13976993129,1cyclictest0-21swapper/010:35:340
1397699310,30cyclictest0-21swapper/011:10:010
1397699310,30cyclictest0-21swapper/010:53:230
1398399300,29cyclictest5711-21diskmemload11:45:213
1398399300,29cyclictest0-21swapper/312:00:193
1398399300,29cyclictest0-21swapper/311:40:013
1398399300,29cyclictest0-21swapper/310:35:293
1398399300,29cyclictest0-21swapper/309:10:293
1398399300,1cyclictest5711-21diskmemload11:55:083
1398399300,1cyclictest0-21swapper/312:10:263
1398399300,0cyclictest0-21swapper/311:10:173
1398299300,29cyclictest5711-21diskmemload12:12:382
1398299300,29cyclictest20975-21apt-config09:24:592
1398299300,1cyclictest755-21snmpd10:14:142
13981993029,1cyclictest0-21swapper/109:20:181
13981993028,2cyclictest0-21swapper/111:53:181
13981993028,2cyclictest0-21swapper/111:10:001
13981993028,2cyclictest0-21swapper/110:48:271
13981993028,1cyclictest29250-21apt-get11:40:191
13981993028,1cyclictest0-21swapper/111:35:331
13981993027,3cyclictest0-21swapper/112:16:271
1398199301,0cyclictest8097-21apt-get08:05:211
1398199300,30cyclictest0-21swapper/112:30:571
1398199300,29cyclictest11226-21apt-get09:15:191
1398199300,0cyclictest0-21swapper/112:22:121
1398199300,0cyclictest0-21swapper/111:13:421
1398199300,0cyclictest0-21swapper/109:26:311
1397699300,29cyclictest5711-21diskmemload12:00:220
1397699300,29cyclictest5711-21diskmemload09:50:230
1397699300,29cyclictest5711-21diskmemload09:42:120
1397699300,29cyclictest5711-21diskmemload09:21:180
1397699300,29cyclictest12191-21apt-get11:55:190
1397699300,29cyclictest0-21swapper/009:46:320
1397699300,1cyclictest6220-21apt-get09:10:220
1397699300,1cyclictest5711-21diskmemload11:53:570
13983992929,0cyclictest5711-21diskmemload12:28:233
13983992929,0cyclictest5711-21diskmemload11:18:193
13983992929,0cyclictest0-21swapper/309:45:193
13983992927,1cyclictest0-21swapper/310:30:293
1398399290,29cyclictest5711-21diskmemload11:32:403
1398399290,29cyclictest5711-21diskmemload09:15:103
1398399290,29cyclictest2330-21/usr/sbin/munin10:10:173
1398399290,29cyclictest110102sleep311:21:273
1398399290,29cyclictest0-21swapper/312:38:543
1398399290,29cyclictest0-21swapper/312:31:003
1398399290,29cyclictest0-21swapper/311:54:303
1398399290,29cyclictest0-21swapper/311:07:513
1398399290,29cyclictest0-21swapper/310:57:233
1398399290,29cyclictest0-21swapper/310:54:153
1398399290,29cyclictest0-21swapper/310:25:093
1398399290,29cyclictest0-21swapper/310:15:053
1398399290,29cyclictest0-21swapper/310:06:513
1398399290,29cyclictest0-21swapper/309:51:483
1398399290,29cyclictest0-21swapper/309:31:213
1398399290,28cyclictest0-21swapper/308:00:223
1398399290,28cyclictest0-21swapper/307:40:163
1398399290,0cyclictest5711-21diskmemload12:15:203
1398399290,0cyclictest5711-21diskmemload11:41:453
1398399290,0cyclictest5711-21diskmemload11:27:513
1398399290,0cyclictest5711-21diskmemload10:20:493
1398399290,0cyclictest5711-21diskmemload09:58:573
1398399290,0cyclictest5390-21ssh10:45:153
1398399290,0cyclictest0-21swapper/312:20:533
1398399290,0cyclictest0-21swapper/312:05:143
1398399290,0cyclictest0-21swapper/311:01:563
1398399290,0cyclictest0-21swapper/310:40:253
1398399290,0cyclictest0-21swapper/310:01:223
1398399290,0cyclictest0-21swapper/309:42:213
1398399290,0cyclictest0-21swapper/309:38:243
1398399290,0cyclictest0-21swapper/309:22:143
1398399290,0cyclictest0-21swapper/307:20:173
13982992928,1cyclictest3426-21perf09:05:012
1398299290,29cyclictest5711-21diskmemload11:56:142
1398299290,29cyclictest5711-21diskmemload11:15:042
1398299290,29cyclictest5711-21diskmemload11:11:172
1398299290,29cyclictest24357-21ssh10:30:362
1398299290,29cyclictest0-21swapper/212:25:162
1398299290,29cyclictest0-21swapper/212:20:102
1398299290,29cyclictest0-21swapper/212:00:062
1398299290,29cyclictest0-21swapper/211:51:392
1398299290,29cyclictest0-21swapper/211:25:222
1398299290,29cyclictest0-21swapper/211:20:152
1398299290,29cyclictest0-21swapper/211:01:042
1398299290,29cyclictest0-21swapper/210:52:322
1398299290,29cyclictest0-21swapper/210:45:262
1398299290,29cyclictest0-21swapper/210:16:522
1398299290,29cyclictest0-21swapper/209:55:372
1398299290,29cyclictest0-21swapper/209:45:312
1398299290,29cyclictest0-21swapper/209:35:172
1398299290,29cyclictest0-21swapper/209:15:332
1398299290,28cyclictest3431-21apt-get07:55:162
1398299290,28cyclictest0-21swapper/212:30:182
1398299290,1cyclictest5711-21diskmemload11:46:062
1398299290,1cyclictest31211-21apt-get07:45:152
1398299290,0cyclictest5711-21diskmemload12:35:082
1398299290,0cyclictest5711-21diskmemload11:41:462
1398299290,0cyclictest5711-21diskmemload10:42:292
1398299290,0cyclictest5711-21diskmemload10:25:282
1398299290,0cyclictest5711-21diskmemload10:21:412
1398299290,0cyclictest5711-21diskmemload10:01:192
1398299290,0cyclictest5711-21diskmemload09:42:342
1398299290,0cyclictest5711-21diskmemload09:12:562
1398299290,0cyclictest0-21swapper/211:05:022
1398299290,0cyclictest0-21swapper/210:35:122
1398299290,0cyclictest0-21swapper/209:51:082
1398299290,0cyclictest0-21swapper/209:30:002
1398299290,0cyclictest0-21swapper/209:25:162
1398299290,0cyclictest0-21swapper/209:05:272
1398299290,0cyclictest0-21swapper/207:25:212
13981992929,0cyclictest21744-21apt-get07:25:211
13981992929,0cyclictest17537-1kworker/u9:110:30:551
13981992929,0cyclictest0-21swapper/110:55:341
13981992928,1cyclictest0-21swapper/112:06:351
13981992928,1cyclictest0-21swapper/111:15:221
13981992928,1cyclictest0-21swapper/110:50:161
13981992928,1cyclictest0-21swapper/109:55:311
1398199290,29cyclictest5711-21diskmemload10:05:551
1398199290,29cyclictest0-21swapper/110:35:191
1398199290,29cyclictest0-21swapper/110:10:041
1398199290,29cyclictest0-21swapper/109:46:131
1398199290,29cyclictest0-21swapper/109:30:131
1398199290,0cyclictest5711-21diskmemload11:31:321
1398199290,0cyclictest0-21swapper/112:10:321
1398199290,0cyclictest0-21swapper/111:47:001
1398199290,0cyclictest0-21swapper/109:50:061
13976992929,0cyclictest5711-21diskmemload12:35:180
13976992929,0cyclictest5711-21diskmemload12:08:000
1397699290,29cyclictest5711-21diskmemload12:26:350
1397699290,29cyclictest5711-21diskmemload12:11:190
1397699290,29cyclictest5711-21diskmemload11:35:110
1397699290,29cyclictest5711-21diskmemload11:27:300
1397699290,29cyclictest5711-21diskmemload11:20:110
1397699290,29cyclictest5711-21diskmemload11:03:400
1397699290,29cyclictest5711-21diskmemload10:31:340
1397699290,29cyclictest5711-21diskmemload10:20:160
1397699290,29cyclictest0-21swapper/012:30:190
1397699290,29cyclictest0-21swapper/012:20:290
1397699290,29cyclictest0-21swapper/011:31:300
1397699290,29cyclictest0-21swapper/011:16:400
1397699290,29cyclictest0-21swapper/011:10:410
1397699290,29cyclictest0-21swapper/010:55:120
1397699290,29cyclictest0-21swapper/010:41:130
1397699290,1cyclictest0-21swapper/010:00:200
1397699290,0cyclictest5711-21diskmemload11:43:010
1397699290,0cyclictest5711-21diskmemload10:15:030
1397699290,0cyclictest5711-21diskmemload10:10:490
1397699290,0cyclictest5711-21diskmemload10:06:110
1397699290,0cyclictest5711-21diskmemload09:55:540
1397699290,0cyclictest5711-21diskmemload09:35:030
1397699290,0cyclictest0-21swapper/012:15:550
1397699290,0cyclictest0-21swapper/011:45:020
1397699290,0cyclictest0-21swapper/010:45:280
1397699290,0cyclictest0-21swapper/010:25:160
1397699290,0cyclictest0-21swapper/009:25:260
1397699290,0cyclictest0-21swapper/009:15:090
1397699290,0cyclictest0-21swapper/007:35:210
13983992828,0cyclictest0-21swapper/309:25:003
13983992828,0cyclictest0-21swapper/308:30:233
13982992828,0cyclictest0-21swapper/212:15:032
13982992828,0cyclictest0-21swapper/212:05:102
13982992828,0cyclictest0-21swapper/210:05:082
1398299280,28cyclictest0-21swapper/211:30:312
13981992828,0cyclictest0-21swapper/108:46:511
1398199280,0cyclictest0-21swapper/107:35:211
13976992828,0cyclictest0-21swapper/009:30:010
13976992828,0cyclictest0-21swapper/008:20:160
13983992727,0cyclictest0-21swapper/307:50:163
13982992727,0cyclictest10414-21apt-get08:10:222
13982992727,0cyclictest0-21swapper/208:46:502
13982992626,0cyclictest17409-21apt-get08:25:242
13976992626,0cyclictest0-21swapper/007:10:020
13983992525,0cyclictest0-21swapper/308:35:213
13983992525,0cyclictest0-21swapper/308:10:003
13983992525,0cyclictest0-21swapper/307:10:023
13982992524,1cyclictest24449-21apt-get08:40:212
13981992523,1cyclictest21756-21sh08:35:001
13983992424,0cyclictest0-21swapper/308:45:183
13983992422,1cyclictest19422-21cron08:30:013
13983992422,1cyclictest0-21swapper/308:45:003
13982992424,0cyclictest0-21swapper/208:55:202
13981992424,0cyclictest19411-21apt-get07:20:171
13976992424,0cyclictest0-21swapper/008:00:230
13976992424,0cyclictest0-21swapper/007:55:170
13976992424,0cyclictest0-21swapper/007:25:200
13982992323,0cyclictest0-21swapper/208:05:002
13981992323,0cyclictest0-21swapper/107:45:161
13976992322,1cyclictest0-21swapper/009:00:010
13983992222,0cyclictest0-21swapper/307:40:023
13982992220,1cyclictest16501-21cron07:15:002
13976992222,0cyclictest0-21swapper/007:30:170
13983992121,0cyclictest0-21swapper/308:10:203
13981992121,0cyclictest0-21swapper/107:55:171
13976992120,1cyclictest1358-21apt-get09:00:160
13976992119,1cyclictest30931-21perf07:45:000
13983992020,0cyclictest24114-21apt-get07:30:183
13982992020,0cyclictest0-21swapper/208:20:172
13982992018,1cyclictest0-21swapper/207:35:022
13981992020,0cyclictest15079-21apt-get08:20:171
13981992018,1cyclictest3161-21perf07:55:011
13976992020,0cyclictest0-21swapper/009:10:000
13983991919,0cyclictest0-21swapper/308:50:183
13983991919,0cyclictest0-21swapper/308:20:173
13981991919,0cyclictest31179-21perf08:55:021
13982991818,0cyclictest26437-21apt-get07:35:212
13976991818,0cyclictest0-21swapper/008:35:210
13983991616,0cyclictest0-21swapper/309:00:163
13982991614,1cyclictest0-21swapper/208:15:222
13981991614,1cyclictest18220-21irqstats08:25:381
1397699160,1cyclictest0-21swapper/008:45:010
13983991514,1cyclictest3701-21apt-get09:05:263
13983991513,1cyclictest13148-21df08:15:203
1398399150,1cyclictest0-21swapper/308:55:263
1398199150,14cyclictest0-21swapper/108:10:211
1398199150,14cyclictest0-21swapper/107:45:001
13976991513,1cyclictest0-21swapper/008:50:240
13983991414,0cyclictest0-21swapper/307:29:573
1398399140,14cyclictest0-21swapper/307:55:193
1398399140,14cyclictest0-21swapper/307:45:083
1398299140,14cyclictest0-21swapper/208:35:332
1398299140,14cyclictest0-21swapper/208:30:232
1398299140,14cyclictest0-21swapper/208:05:122
1398299140,14cyclictest0-21swapper/207:50:102
1398299140,14cyclictest0-21swapper/207:15:032
1398299140,0cyclictest0-21swapper/208:53:522
1398299140,0cyclictest0-21swapper/207:41:492
13981991414,0cyclictest13894-21apt-get07:10:011
13981991414,0cyclictest0-21swapper/107:18:581
13981991413,1cyclictest23013-21memory08:35:281
1398199140,14cyclictest0-21swapper/108:55:061
1398199140,14cyclictest0-21swapper/107:33:321
1398199140,0cyclictest0-21swapper/109:06:401
1398199140,0cyclictest0-21swapper/108:16:051
1398199140,0cyclictest0-21swapper/108:00:021
13976991412,1cyclictest0-21swapper/008:05:300
1397699140,14cyclictest0-21swapper/008:45:130
1397699140,14cyclictest0-21swapper/008:25:140
1397699140,14cyclictest0-21swapper/007:50:180
1397699140,14cyclictest0-21swapper/007:45:120
1397699140,14cyclictest0-21swapper/007:21:460
1397699140,14cyclictest0-21swapper/007:15:050
1397699140,0cyclictest0-21swapper/008:15:440
1397699140,0cyclictest0-21swapper/008:10:390
13983991313,0cyclictest0-21swapper/307:15:293
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional