You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-06-27 - 04:17

x86 Intel Core i3-2310E @2100 MHz, Linux 5.10.47-rt46 (Profile)

Latency plot of system in rack #8, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by a total of 2 SMIs that occured during the measurement.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot2.osadl.org (updated Mon Jun 27, 2022 00:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2641899139131,7cyclictest0-21swapper/119:18:311
2642099127123,1cyclictest0-21swapper/319:15:023
26103210745,31sleep30-21swapper/319:14:293
124352960,0sleep10-21swapper/100:37:121
2582029148,31sleep00-21swapper/019:10:490
2597329047,31sleep20-21swapper/219:12:482
2582129048,31sleep10-21swapper/119:10:501
26419998179,1cyclictest0-21swapper/219:18:312
290362720,0sleep00-21swapper/023:11:040
27952310,1sleep30-21swapper/322:10:183
59032290,1sleep20-21swapper/222:46:572
26417992927,1cyclictest0-21swapper/019:15:020
258982290,0sleep10-21swapper/120:25:211
2641999280,27cyclictest0-21swapper/200:10:112
2642099270,26cyclictest0-21swapper/322:35:213
19342270,1sleep228-21ksoftirqd/221:35:132
2641899260,24cyclictest0-21swapper/120:15:101
71882250,0sleep00-21swapper/020:55:230
2641799250,23cyclictest14671-21ssh21:15:100
117962240,0sleep20-21swapper/200:00:532
2641799227,6cyclictest29138-21grep23:45:190
2641799221,20cyclictest0-21swapper/000:10:120
26418992119,1cyclictest0-21swapper/100:05:111
20612210,1sleep12067-21gltestperf20:45:141
26418992014,5cyclictest22-21ksoftirqd/119:32:291
2641899200,1cyclictest0-21swapper/123:40:101
2641799206,7cyclictest11731-21awk19:54:590
2641899194,5cyclictest141rcu_preempt19:38:191
2641899190,10cyclictest0-21swapper/123:37:431
2641799194,8cyclictest1195-21munin-run20:44:590
2641799192,16cyclictest0-21swapper/021:30:170
26418991812,5cyclictest22-21ksoftirqd/120:32:251
2641799186,4cyclictest10402-21ssh22:18:000
2641799184,4cyclictest24303-21awk21:25:100
2642099171,11cyclictest0-21swapper/323:44:263
26418991712,2cyclictest22-21ksoftirqd/123:29:231
26418991711,5cyclictest22-21ksoftirqd/121:15:231
26418991711,5cyclictest22-21ksoftirqd/120:05:551
2641899171,13cyclictest141rcu_preempt21:47:331
2641799177,2cyclictest28445-21ssh22:02:430
2641799176,2cyclictest20452-21ssh23:35:560
2641799174,7cyclictest27680-21sendmail-msp23:44:590
2641799174,5cyclictest32666-21perf00:24:590
2641899167,4cyclictest22-21ksoftirqd/120:38:071
2641899166,5cyclictest22-21ksoftirqd/123:09:471
2641899166,5cyclictest22-21ksoftirqd/119:21:391
2641899166,5cyclictest22-21ksoftirqd/119:21:391
2641899163,6cyclictest22-21ksoftirqd/123:53:581
2641899162,2cyclictest141rcu_preempt22:04:111
26418991610,5cyclictest22-21ksoftirqd/121:35:291
2641799168,6cyclictest20516-21tail21:20:190
2641799167,7cyclictest3037-21tune2fs22:10:200
2641799165,4cyclictest18068-21ssh00:43:520
2641799163,4cyclictest4046-21runrttasks21:36:580
83542150,1chrt0-21swapper/122:50:131
2641999155,5cyclictest30493-21ssh23:46:472
2641899159,1cyclictest22-21ksoftirqd/120:40:391
2641899156,4cyclictest22-21ksoftirqd/120:58:351
2641899154,6cyclictest22-21ksoftirqd/100:10:071
2641899151,6cyclictest141rcu_preempt23:19:591
26418991510,4cyclictest22-21ksoftirqd/121:24:051
26418991510,2cyclictest22-21ksoftirqd/120:11:091
26418991510,2cyclictest22-21ksoftirqd/119:50:591
2641799154,6cyclictest31248-21ssh22:40:120
2641799154,4cyclictest11077-21ssh21:45:090
2641799154,3cyclictest14329-21diskmemload23:09:350
2641799154,3cyclictest14329-21diskmemload23:04:140
2641799153,8cyclictest2251-21ssh23:50:500
2641799153,4cyclictest14329-21diskmemload21:44:170
26417991510,3cyclictest18716-21cpuspeed_turbos20:10:110
2642099145,4cyclictest0-21swapper/320:00:493
2642099141,8cyclictest27536-21ssh22:01:113
2642099140,12cyclictest18815-21ssh21:19:343
2641999144,5cyclictest30904-21ssh21:30:362
2641899149,4cyclictest22-21ksoftirqd/122:32:471
2641899149,2cyclictest22-21ksoftirqd/100:44:361
2641899146,5cyclictest22-21ksoftirqd/122:40:311
2641899145,8cyclictest0-21swapper/100:33:141
2641899145,4cyclictest16074-21ssh22:58:041
2641899145,4cyclictest0-21swapper/121:50:451
2641899144,5cyclictest22-21ksoftirqd/122:11:351
2641899142,7cyclictest141rcu_preempt00:15:141
2641899142,4cyclictest141rcu_preempt23:31:451
2641899140,2cyclictest141rcu_preempt22:28:491
2641899140,2cyclictest141rcu_preempt22:28:491
2641799147,5cyclictest9116-21cpuspeed_turbos23:25:110
2641799147,5cyclictest7677-21/usr/sbin/munin19:45:100
2641799147,5cyclictest6051-21/usr/sbin/munin23:55:170
2641799147,5cyclictest6051-21/usr/sbin/munin23:55:170
2641799147,5cyclictest3732-21/usr/sbin/munin19:35:130
2641799147,5cyclictest30408-21/usr/sbin/munin19:20:200
2641799147,5cyclictest30408-21/usr/sbin/munin19:20:200
2641799147,5cyclictest22049-21fschecks_time22:30:150
2641799147,5cyclictest21926-21/usr/sbin/munin20:15:210
2641799147,5cyclictest2168-21/usr/sbin/munin20:45:150
2641799147,5cyclictest17218-21/usr/sbin/munin22:25:130
2641799147,5cyclictest17218-21/usr/sbin/munin22:25:130
2641799147,5cyclictest1697-21/usr/sbin/munin19:30:140
2641799147,5cyclictest14037-21basename00:39:590
2641799147,5cyclictest13868-21aten2_r8power_p23:30:170
2641799147,5cyclictest13857-21cron19:59:590
2641799147,5cyclictest12055-21ls21:09:590
2641799146,6cyclictest8828-21/usr/sbin/munin21:00:170
2641799146,6cyclictest23011-21grep20:20:120
2641799146,6cyclictest15707-21ls00:05:180
2641799145,7cyclictest5828-21grep23:20:230
2641799144,3cyclictest14329-21diskmemload23:15:310
2641799144,3cyclictest0-21swapper/000:15:450
2641799142,7cyclictest0-21swapper/022:45:160
2641799141,8cyclictest0-21swapper/022:05:280
211882142,7sleep30-21swapper/320:15:143
2642099137,4cyclictest4364-21tr23:20:123
2642099135,5cyclictest0-21swapper/322:41:363
2642099135,3cyclictest0-21swapper/300:15:183
2642099134,6cyclictest30774-21ssh00:21:393
2642099133,5cyclictest21039-21ssh23:36:563
2642099133,5cyclictest0-21swapper/321:49:283
2641999137,4cyclictest12046-21http21:09:592
2641999134,4cyclictest3045-21ssh22:10:202
2641999134,4cyclictest25272-21ssh23:41:052
2641999133,5cyclictest8775-21hddtemp_smartct22:50:152
2641999132,6cyclictest8479-21irqstats19:45:152
2641999132,5cyclictest0-21swapper/220:45:152
2641999130,3cyclictest32191-21cpuspeed_turbos23:15:122
2641899138,4cyclictest0-21swapper/122:21:231
2641899138,3cyclictest22-21ksoftirqd/121:33:291
2641899135,5cyclictest6271-21ssh21:40:101
2641899135,2cyclictest22-21ksoftirqd/122:47:561
2641899134,8cyclictest0-21swapper/121:07:591
2641899134,4cyclictest24421-21ssh21:58:561
2641899134,4cyclictest0-21swapper/120:52:271
2641899134,4cyclictest0-21swapper/119:55:141
2641899134,2cyclictest141rcu_preempt23:55:181
2641899134,2cyclictest141rcu_preempt23:55:181
2641899133,6cyclictest22-21ksoftirqd/122:17:131
2641899133,6cyclictest22-21ksoftirqd/122:07:511
2641899133,6cyclictest141rcu_preempt19:25:121
2641899133,2cyclictest141rcu_preempt00:00:101
2641899132,6cyclictest141rcu_preempt00:29:431
2641899131,8cyclictest25108-21taskset21:25:151
2641899131,7cyclictest22-21ksoftirqd/123:11:231
2641899130,6cyclictest141rcu_preempt00:20:141
2641799137,4cyclictest32123-21/usr/sbin/munin19:25:150
2641799137,4cyclictest12804-21if_enp3s022:20:280
2641799136,5cyclictest9356-21proc_pri22:50:210
2641799136,5cyclictest7669-21rm00:31:510
2641799136,5cyclictest5572-21wget19:40:110
2641799136,5cyclictest3907-21expr20:50:140
2641799136,5cyclictest26176-21cat22:35:100
2641799136,5cyclictest25910-21sed20:25:210
2641799136,5cyclictest21104-21cat21:55:120
2641799136,5cyclictest16018-21aten2_r8power_v21:50:120
2641799136,5cyclictest1511-21latency00:25:180
2641799136,5cyclictest14800-21cat20:00:140
2641799136,5cyclictest13301-21awk22:55:130
2641799136,5cyclictest12514-21aten2_r8power_v21:10:120
2641799136,5cyclictest10308-21ssh00:00:120
2642099126,4cyclictest14719-21tr00:05:123
2642099126,4cyclictest12008-21cron21:09:593
2642099124,7cyclictest0-21swapper/321:03:093
2642099124,4cyclictest31684-21dpkg20:40:013
2642099122,6cyclictest15290-21ls23:30:293
2642099122,5cyclictest29722-21ssh23:45:293
2642099122,5cyclictest14059-21ssh00:04:393
2642099120,8cyclictest25406-21ssh22:34:153
2642099120,7cyclictest2184-21kworker/u8:123:25:153
2641999127,3cyclictest25866-21grep21:25:222
2641999125,5cyclictest238-21systemd-journal22:34:592
2641999125,5cyclictest0-21swapper/223:21:372
2641999124,3cyclictest0-21swapper/223:33:412
2641999123,4cyclictest0-21swapper/200:07:242
2641999122,5cyclictest6540-21ntp_states19:40:182
2641999121,9cyclictest5533-21basename20:54:592
2641999121,6cyclictest0-21swapper/220:19:222
2641999121,4cyclictest12885-21/usr/sbin/munin22:20:282
2641899127,2cyclictest22-21ksoftirqd/122:36:251
2641899125,2cyclictest22-21ksoftirqd/121:02:191
2641899124,6cyclictest590-21snmpd20:00:191
2641899122,6cyclictest22-21ksoftirqd/123:45:251
2641899122,5cyclictest141rcu_preempt19:45:191
2641899121,6cyclictest141rcu_preempt20:20:221
2641899121,1cyclictest141rcu_preempt23:15:411
2641799127,4cyclictest27420-21cpuspeed_turbos20:30:120
2641799127,4cyclictest17359-21/usr/sbin/munin20:05:180
2641799125,5cyclictest29880-21fschecks_count20:35:130
22272120,3sleep334-21ksoftirqd/300:25:283
145562120,1sleep20-21swapper/221:15:012
2642099116,4cyclictest28591-21kworker/3:223:00:173
2642099116,4cyclictest28591-21kworker/3:221:55:113
2642099116,4cyclictest28591-21kworker/3:221:40:233
2642099116,4cyclictest28591-21kworker/3:219:41:593
2642099115,5cyclictest28591-21kworker/3:223:05:533
2642099115,5cyclictest28591-21kworker/3:220:39:233
2642099115,5cyclictest28591-21kworker/3:220:29:493
2642099115,5cyclictest28591-21kworker/3:219:55:093
2642099115,5cyclictest28591-21kworker/3:219:46:033
2642099115,4cyclictest32034-21grep19:25:143
2642099115,4cyclictest27258-21tr23:10:133
2642099115,4cyclictest15924-21cut21:50:113
2642099115,4cyclictest14529-21cat21:15:003
2642099115,4cyclictest12674-21head22:20:263
2642099115,4cyclictest0-21swapper/300:30:043
2642099114,5cyclictest0-21swapper/320:30:103
2642099112,4cyclictest0-21swapper/320:20:153
2642099111,6cyclictest15349-21ssh22:56:513
2642099111,5cyclictest16447-21ssh00:40:563
2642099111,5cyclictest0-21swapper/323:15:163
2642099110,9cyclictest6008-21tr20:55:113
2642099110,5cyclictest23490-21ssh21:24:193
2642099110,4cyclictest2382-21latency20:45:163
2641999117,2cyclictest9858-21idleruntime-cro21:04:592
2641999117,2cyclictest25652-21grep22:00:122
2641999116,4cyclictest4377-21ntpq19:35:192
2641999116,3cyclictest8293-21sh21:40:592
2641999116,3cyclictest14850irq/32-ahci[00000:15:112
2641999115,5cyclictest0-21swapper/223:14:162
2641999115,5cyclictest0-21swapper/223:07:222
2641999115,4cyclictest14174-21tr20:00:102
2641999114,5cyclictest0-21swapper/222:42:242
2641999113,5cyclictest0-21swapper/219:20:022
2641999113,5cyclictest0-21swapper/219:20:022
2641999113,3cyclictest0-21swapper/200:30:172
2641999113,2cyclictest0-21swapper/200:40:362
2641999110,9cyclictest26882-21hddtemp_smartct22:35:152
2641999110,9cyclictest21168-21wc22:29:592
2641999110,9cyclictest21168-21wc22:29:592
2641999110,5cyclictest16266-21/usr/sbin/munin20:05:172
2641999110,5cyclictest0-21swapper/223:00:152
2641899113,3cyclictest22-21ksoftirqd/123:00:101
2641899111,6cyclictest22-21ksoftirqd/121:10:151
2641899110,4cyclictest5523-21aten2_r8power_p19:40:101
2642099107,2cyclictest3688-21aten2_r8power_p20:50:143
2642099107,2cyclictest29744-21fschecks_time19:20:143
2642099107,2cyclictest29744-21fschecks_time19:20:143
2642099107,2cyclictest24315-21aten2_r8power_e21:25:103
2642099106,2cyclictest10770-21missed_timers19:50:183
2642099105,4cyclictest4095-21if_enp5s022:45:163
2642099105,4cyclictest28591-21kworker/3:222:05:133
2642099105,4cyclictest0-21swapper/300:10:483
2642099105,3cyclictest29216-21sh21:30:183
2642099104,5cyclictest28591-21kworker/3:219:29:593
2642099104,4cyclictest7463-21grep22:15:123
2642099104,4cyclictest1923-21grep23:50:223
2642099104,4cyclictest17614-21threads20:05:213
2642099104,4cyclictest17260-21cut22:25:133
2642099104,4cyclictest17260-21cut22:25:133
2642099104,4cyclictest0-21swapper/320:11:313
2642099103,5cyclictest590-21snmpd19:36:423
2642099103,5cyclictest2627-21sh21:35:203
2642099101,4cyclictest11662-21ssh00:35:503
2642099100,5cyclictest9196-21head22:50:193
2642099100,5cyclictest5526-21grep23:55:143
2642099100,5cyclictest5526-21grep23:55:143
2641999107,2cyclictest29603-21ntp_states00:20:182
2641999106,3cyclictest1380-21if_err_enp3s000:25:172
2641999105,3cyclictest31604-21cpuspeed_turbos19:25:122
2641999105,3cyclictest30005-21gltestperf20:35:142
2641999105,3cyclictest0-21swapper/223:50:022
2641999105,3cyclictest0-21swapper/220:10:432
2641999104,5cyclictest6890-21pmu-power20:55:202
2641999104,5cyclictest0-21swapper/223:35:212
2641999104,5cyclictest0-21swapper/221:50:292
2641999104,5cyclictest0-21swapper/200:35:102
2641999104,4cyclictest6393-21mailstats23:55:212
2641999104,4cyclictest6393-21mailstats23:55:212
2641999104,4cyclictest590-21snmpd19:33:062
2641999104,4cyclictest31695-21/usr/sbin/munin20:40:092
2641999104,4cyclictest238-21systemd-journal20:29:462
2641999104,4cyclictest12519-21tail19:55:132
2641999104,4cyclictest10386-21grep19:50:142
2641999104,4cyclictest0-21swapper/222:05:592
2641999103,6cyclictest0-21swapper/223:26:332
2641999103,5cyclictest238-21systemd-journal22:15:082
2641999102,6cyclictest0-21swapper/221:55:082
2641999101,5cyclictest0-21swapper/220:30:152
2641999100,8cyclictest17095-21ssh22:59:462
2641999100,4cyclictest12396-21/usr/sbin/munin21:10:162
2641999100,4cyclictest11567-21diskstats21:45:142
264199995,2cyclictest19727-21grep21:20:112
264199991,3cyclictest590-21snmpd20:20:102
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional