You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-01-28 - 07:39

x86 Intel Core i3-2310E @2100 MHz, Linux 5.10.47-rt46 (Profile)

Latency plot of system in rack #8, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by a total of 2 SMIs that occured during the measurement.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot2.osadl.org (updated Sat Jan 28, 2023 00:43:38)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1395499145143,1cyclictest0-21swapper/219:11:212
13952991441,1cyclictest0-21swapper/019:41:300
1395599125122,2cyclictest0-21swapper/319:11:213
139539910292,9cyclictest13988-21apt-get19:11:211
215572920,1sleep10-21swapper/119:26:241
172542800,1sleep30-21swapper/323:37:443
47102780,0sleep00-21swapper/000:33:040
13952994846,1cyclictest0-21swapper/019:11:210
13954994442,1cyclictest0-21swapper/219:41:302
198882320,0chrt0-21swapper/322:35:283
205932270,1sleep120595-21unixbench_multi20:36:341
1395599278,15cyclictest6709-21sed23:26:383
264682260,0sleep30-21swapper/323:14:593
1395299261,4cyclictest12550-21rm23:01:210
13955992522,2cyclictest0-21swapper/319:41:303
75562240,0sleep20-21swapper/222:56:152
206202240,1sleep10-21swapper/121:28:561
1395599234,16cyclictest10017-21fschecks_count21:51:303
243982220,0sleep00-21swapper/021:31:440
1395599222,15cyclictest27817-21ssh23:16:243
1395399220,21cyclictest0-21swapper/123:16:211
15992210,0sleep00-21swapper/023:21:340
1395599213,14cyclictest0-21swapper/319:51:283
1395599213,11cyclictest0-21swapper/319:56:283
1395599212,17cyclictest23772-21/usr/sbin/munin21:31:323
1395599212,17cyclictest20448-21ssh23:08:243
1395599211,11cyclictest8619-21sed21:16:383
1395599204,5cyclictest15149-21grep21:56:303
1395599203,12cyclictest2267-21ssh23:22:223
1395599202,4cyclictest13443-21ssh23:34:343
1395599202,16cyclictest26605-21ssh22:08:323
1395599201,9cyclictest15496-21idleruntime-cro22:31:103
1395599201,2cyclictest3361-21systemctl21:11:343
1395599201,17cyclictest23239-21ssh00:17:443
13952992016,2cyclictest1817-21apt19:56:210
1395599196,12cyclictest0-21swapper/323:56:223
1395599195,12cyclictest30559-21if_enp4s023:51:283
1395599195,12cyclictest30559-21if_enp4s023:51:283
1395599193,12cyclictest0-21swapper/322:46:303
1395599192,6cyclictest22366-21ntp_states19:26:343
1395599191,3cyclictest14931-21/usr/sbin/munin20:26:223
1395599191,15cyclictest11579-21apt-get00:06:223
1395599191,10cyclictest0-21swapper/300:36:303
1395299194,8cyclictest1588-21awk19:56:090
1395299193,8cyclictest21095-21idleruntime-cro20:41:090
1395599186,11cyclictest0-21swapper/322:56:103
1395599185,11cyclictest18744-21ssh00:12:543
1395599184,11cyclictest0-21swapper/323:41:283
1395599184,11cyclictest0-21swapper/322:20:143
1395599184,11cyclictest0-21swapper/320:31:343
1395599182,4cyclictest30960-21sh21:39:343
1395599181,1cyclictest9114-21ssh21:51:083
1395599181,1cyclictest8181-21missed_timers00:01:303
1395599181,14cyclictest0-21swapper/319:46:363
1395599180,5cyclictest3232-21missed_timers00:31:323
1395299187,4cyclictest7188-21ntpq22:21:320
1395299184,5cyclictest1805-21awk22:16:280
1395299180,17cyclictest0-21swapper/022:01:220
1395599177,9cyclictest0-21swapper/322:22:243
1395599175,9cyclictest0-21swapper/321:26:263
1395599175,11cyclictest25836-21ls23:46:303
1395599175,11cyclictest0-21swapper/322:05:163
1395599174,12cyclictest0-21swapper/320:01:223
1395599174,10cyclictest0-21swapper/321:41:363
1395599172,5cyclictest0-21swapper/323:01:363
1395599172,5cyclictest0-21swapper/300:21:243
1395599171,14cyclictest21013-21tr22:36:243
1395299176,3cyclictest24767-21sh00:20:190
1395299175,3cyclictest14422-21latency_hist23:36:100
1395299174,7cyclictest12204-21awk23:01:090
1395299174,5cyclictest586-21snmpd19:46:290
1395299170,6cyclictest41692sleep021:12:200
1395599168,7cyclictest0-21swapper/322:55:243
1395599168,7cyclictest0-21swapper/322:44:403
1395599168,7cyclictest0-21swapper/322:13:403
1395599168,7cyclictest0-21swapper/322:13:403
1395599168,7cyclictest0-21swapper/300:26:403
1395599165,8cyclictest0-21swapper/320:36:243
1395599164,11cyclictest0-21swapper/321:24:483
1395599162,11cyclictest0-21swapper/321:06:363
1395599162,11cyclictest0-21swapper/320:56:363
1395599161,5cyclictest0-21swapper/321:01:243
1395599161,14cyclictest0-21swapper/320:11:263
1395599160,3cyclictest6163-21apt-get20:06:223
1395299161,5cyclictest9109-21sh21:17:050
1395299161,2cyclictest0-21swapper/020:53:580
1395299160,9cyclictest6771-21idleruntime-cro00:01:100
1395599158,6cyclictest0-21swapper/320:50:043
1395599157,7cyclictest0-21swapper/319:31:243
1395599156,8cyclictest0-21swapper/320:41:203
1395599150,5cyclictest0-21swapper/320:51:263
1395399158,5cyclictest13733-21ntp_states23:01:321
1395399155,5cyclictest0-21swapper/119:53:151
1395299155,3cyclictest20216-21ssh23:41:220
1395599146,7cyclictest0-21swapper/319:36:323
1395599146,7cyclictest0-21swapper/319:22:143
1395599144,4cyclictest0-21swapper/319:16:343
1395599143,4cyclictest0-21swapper/320:19:043
1395499147,5cyclictest25385-21cron20:51:102
1395499144,5cyclictest0-21swapper/219:37:112
1395499143,8cyclictest10890-21ssh23:31:302
1395399145,4cyclictest23024-21df_inode23:11:231
1395399144,5cyclictest0-21swapper/123:53:541
1395399144,5cyclictest0-21swapper/123:53:541
1395399144,5cyclictest0-21swapper/119:56:271
1395399143,6cyclictest0-21swapper/122:45:411
1395299145,2cyclictest15480-21latency_hist22:31:100
1395299144,5cyclictest0-21swapper/023:17:530
1395299143,9cyclictest18922-21perf20:36:090
1395299140,2cyclictest0-21swapper/020:26:260
1395599131,9cyclictest0-21swapper/320:24:123
1395499138,3cyclictest12266-21cut00:06:292
1395499136,5cyclictest28-21ksoftirqd/220:01:512
1395499135,4cyclictest0-21swapper/219:53:302
1395499135,3cyclictest0-21swapper/221:51:092
1395499134,4cyclictest0-21swapper/223:25:542
1395499134,4cyclictest0-21swapper/200:30:382
1395499130,10cyclictest21233-21sh21:29:502
1395399139,2cyclictest1629-21idleruntime-cro21:11:091
1395399135,7cyclictest0-21swapper/120:16:261
1395399135,5cyclictest0-21swapper/100:16:221
1395399133,5cyclictest0-21swapper/120:42:461
1395399132,8cyclictest31839-21ssh21:41:001
1395399131,7cyclictest0-21swapper/122:59:081
1395299134,4cyclictest0-21swapper/022:08:570
1395499127,3cyclictest0-21swapper/219:26:592
1395499125,5cyclictest14808-21basename20:26:202
1395499124,6cyclictest0-21swapper/223:07:352
1395499124,6cyclictest0-21swapper/222:06:372
1395499124,6cyclictest0-21swapper/200:13:242
1395499124,3cyclictest0-21swapper/222:48:112
1395499123,4cyclictest0-21swapper/223:42:032
1395399127,3cyclictest2389-21aten2_r8power_v23:56:231
1395399126,4cyclictest231-21systemd-journal20:11:091
1395399125,5cyclictest0-21swapper/122:05:181
1395399125,5cyclictest0-21swapper/119:20:591
1395399124,5cyclictest0-21swapper/100:11:521
13953991210,1cyclictest0-21swapper/122:26:231
1395399120,1cyclictest0-21swapper/121:31:291
1395399120,10cyclictest745-21grep23:21:251
1395299127,3cyclictest1634-21diskmemload00:26:420
1395299126,4cyclictest27837-21tr20:56:260
1395299126,4cyclictest25685-21tr19:36:210
1395299126,4cyclictest231-21systemd-journal19:36:090
1395299125,5cyclictest13825-21awk21:21:340
1395299124,6cyclictest0-21swapper/020:44:580
1395299124,6cyclictest0-21swapper/020:11:260
1395299123,8cyclictest0-21swapper/022:33:250
1395299123,4cyclictest0-21swapper/021:38:390
280352110,0sleep00-21swapper/000:22:540
1395499117,3cyclictest0-21swapper/223:02:082
1395499117,3cyclictest0-21swapper/219:25:472
1395499116,4cyclictest231-21systemd-journal20:13:432
1395499115,4cyclictest586-21snmpd19:46:432
1395499115,4cyclictest3315-21tr00:31:322
1395499115,4cyclictest0-21swapper/223:51:212
1395499115,4cyclictest0-21swapper/223:51:212
1395499115,3cyclictest0-21swapper/220:44:522
1395499114,5cyclictest519-21dbus-daemon23:41:092
1395499114,5cyclictest519-21dbus-daemon21:51:372
1395499114,5cyclictest0-21swapper/223:18:312
1395499114,5cyclictest0-21swapper/221:09:532
1395499114,5cyclictest0-21swapper/219:56:332
1395499114,5cyclictest0-21swapper/200:20:492
1395499114,5cyclictest0-21swapper/200:01:532
1395499114,4cyclictest0-21swapper/220:23:422
1395499113,3cyclictest0-21swapper/219:17:322
1395499112,4cyclictest0-21swapper/221:36:322
1395499111,8cyclictest6760-21munin-run21:16:092
1395499111,8cyclictest5502-21http22:21:102
1395499111,5cyclictest0-21swapper/222:34:252
1395499111,3cyclictest30054-21munin-run22:46:102
1395499111,3cyclictest29931-21munin-run00:26:102
1395499110,9cyclictest5957-21munin-node22:21:202
1395499110,6cyclictest8066-21cron20:11:092
1395499110,4cyclictest29332-21rm22:11:312
1395499110,4cyclictest29332-21rm22:11:312
1395399117,2cyclictest5719-21cp22:21:101
1395399117,2cyclictest13828-21latency_hist21:56:091
1395399117,2cyclictest11868-21grep00:06:241
1395399115,5cyclictest0-21swapper/122:38:011
1395399115,5cyclictest0-21swapper/121:14:141
1395399115,5cyclictest0-21swapper/120:46:551
1395399115,4cyclictest6045-21mailstats21:46:331
1395399115,4cyclictest19580-21sed19:21:251
1395399114,5cyclictest1634-21diskmemload22:51:291
1395399114,5cyclictest0-21swapper/123:36:301
1395399114,5cyclictest0-21swapper/122:46:441
1395399114,5cyclictest0-21swapper/120:31:251
1395399114,5cyclictest0-21swapper/100:40:591
1395399114,5cyclictest0-21swapper/100:31:561
1395399111,5cyclictest29618-21ssh00:25:411
1395299117,2cyclictest12278-21grep00:06:290
1395299116,4cyclictest1029-21ntpq21:41:320
1395299116,3cyclictest564-21runrttasks22:36:250
1395299115,4cyclictest25336-21grep23:46:250
1395299115,4cyclictest10615-21sendmail00:41:090
1395299114,5cyclictest0-21swapper/019:17:470
1395299113,7cyclictest0-21swapper/000:03:550
1395299110,9cyclictest7277-21cron22:56:090
1395299110,6cyclictest13671-21ls20:21:300
1395499107,2cyclictest3599-21if_enp3s022:51:262
1395499106,3cyclictest27128-21unixbench_singl20:51:392
1395499106,3cyclictest14186-21apt21:56:212
1395499106,2cyclictest1634-21diskmemload23:58:462
1395499105,3cyclictest432-21gltestperf21:41:262
1395499105,3cyclictest18109-21ls20:31:322
1395499104,5cyclictest0-21swapper/223:14:002
1395499104,5cyclictest0-21swapper/222:37:062
1395499104,5cyclictest0-21swapper/221:24:442
1395499104,4cyclictest9808-21ssh21:18:082
1395499104,4cyclictest29180-21timerandwakeup20:56:392
1395499104,4cyclictest19936-21cat20:36:262
1395499104,4cyclictest10590-21aten2_r8power_v20:16:222
1395499104,4cyclictest0-21swapper/223:26:242
1395499104,4cyclictest0-21swapper/200:36:232
1395499103,2cyclictest0-21swapper/222:28:192
1395499102,6cyclictest0-21swapper/223:46:122
1395499101,2cyclictest0-21swapper/222:01:332
1395499100,4cyclictest22605-21basename21:31:212
1395399107,2cyclictest30551-21cstates00:26:261
1395399107,2cyclictest23858-21df19:31:231
1395399106,3cyclictest1634-21diskmemload00:04:031
1395399106,2cyclictest564-21runrttasks22:31:211
1395399106,2cyclictest564-21runrttasks21:56:331
1395399106,2cyclictest25594-21apt19:36:201
1395399105,4cyclictest27775-21apt-get19:41:211
1395399105,4cyclictest0-21swapper/123:26:121
1395399105,3cyclictest533-21in:imuxsock23:32:431
1395399105,3cyclictest15343-21fschecks_time20:26:241
1395399105,3cyclictest0-21swapper/123:41:291
1395399104,5cyclictest1634-21diskmemload23:08:351
1395399104,5cyclictest0-21swapper/121:21:581
1395399104,5cyclictest0-21swapper/121:16:231
1395399104,4cyclictest30678-21if_enp3s021:01:281
1395399104,4cyclictest13137-21fschecks_count20:21:251
1395399103,5cyclictest0-21swapper/122:24:551
1395399103,5cyclictest0-21swapper/122:13:581
1395399103,5cyclictest0-21swapper/122:13:581
1395399103,5cyclictest0-21swapper/120:01:241
1395299106,2cyclictest26200-21sh22:41:260
1395299105,4cyclictest18831-21cut23:06:320
1395299105,3cyclictest5307-21cut21:46:240
1395299105,3cyclictest29760-21sh23:51:210
1395299105,3cyclictest29760-21sh23:51:210
1395299105,3cyclictest19190-21grep19:21:230
1395299105,3cyclictest0-21swapper/021:26:200
1395299104,5cyclictest14844-21head21:56:250
1395299104,5cyclictest0-21swapper/019:26:320
1395299104,5cyclictest0-21swapper/000:11:310
1395299104,4cyclictest8087-21basename20:11:090
1395299104,4cyclictest5305-21sensors20:01:340
1395299104,4cyclictest30601-21sed21:01:270
1395299104,4cyclictest28835-21tr22:11:230
1395299104,4cyclictest28835-21tr22:11:230
1395299104,4cyclictest14990-21tr23:36:230
1395299104,4cyclictest11016-21tune2fs20:16:240
1395299103,5cyclictest9587-21cut21:51:220
1395299103,5cyclictest22774-21cat23:11:220
1395299102,5cyclictest0-21swapper/020:48:040
1395299102,2cyclictest0-21swapper/023:26:310
139549995,3cyclictest564-21runrttasks21:05:552
139549994,3cyclictest24044-21tail19:31:252
139539996,2cyclictest28096-21cstates20:56:281
139539995,3cyclictest25047-21cstates23:46:231
139539995,2cyclictest24290-21fschecks_count22:06:251
139539994,3cyclictest30158-21grep19:46:231
139539993,4cyclictest32381-21cut21:41:231
139539993,4cyclictest25653-21aten2_r8power_c20:51:251
139539990,8cyclictest0-21swapper/120:11:201
139529995,2cyclictest32267-21grep21:06:260
139529994,3cyclictest30652-21grep22:46:220
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional