You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-07-04 - 04:11

x86 Intel Core i5-750 @2667 MHz, Linux 4.9.47-rt37 (Profile)

Latency plot of system in rack #8, slot #3
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack8slot3.osadl.org (updated Mon Jul 04, 2022 00:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1662222094,121sleep30-21swapper/319:05:293
19182183164,15sleep20-21swapper/219:08:212
18632178159,15sleep10-21swapper/119:07:391
18442170108,58sleep00-21swapper/019:07:300
27182900,7sleep30-21swapper/323:18:073
66572810,3sleep20-21swapper/222:09:212
166402810,2sleep10-21swapper/123:34:111
2324993313,19cyclictest0-21swapper/200:05:122
2324993221,10cyclictest0-21swapper/221:22:032
232499319,21cyclictest0-21swapper/222:47:162
232499319,21cyclictest0-21swapper/222:41:152
232499319,21cyclictest0-21swapper/222:23:402
232499318,22cyclictest0-21swapper/223:38:132
232499318,22cyclictest0-21swapper/221:45:262
232499316,24cyclictest0-21swapper/200:19:122
232499316,24cyclictest0-21swapper/200:19:122
232499309,20cyclictest0-21swapper/223:15:472
232499309,20cyclictest0-21swapper/221:54:242
232499309,20cyclictest0-21swapper/200:03:242
232499308,21cyclictest0-21swapper/222:35:502
232499308,21cyclictest0-21swapper/221:42:082
232499306,23cyclictest0-21swapper/222:12:322
232499305,24cyclictest0-21swapper/222:25:322
232499304,25cyclictest0-21swapper/223:01:342
2324993019,11cyclictest2321-21cyclictest22:15:222
2324993016,13cyclictest0-21swapper/223:13:062
2323993011,18cyclictest0-21swapper/122:25:271
232499299,20cyclictest0-21swapper/222:00:332
232499298,20cyclictest0-21swapper/222:55:012
232499298,20cyclictest0-21swapper/221:35:382
232499297,22cyclictest0-21swapper/223:40:512
232499297,21cyclictest0-21swapper/223:28:302
232499297,21cyclictest0-21swapper/223:08:112
232499297,21cyclictest0-21swapper/200:27:282
232499296,22cyclictest0-21swapper/221:33:512
232499295,23cyclictest0-21swapper/223:54:442
232499294,24cyclictest0-21swapper/223:23:472
2325992815,12cyclictest119862sleep322:15:123
232499288,19cyclictest0-21swapper/200:35:122
232499287,21cyclictest0-21swapper/223:58:252
232499287,20cyclictest0-21swapper/223:45:022
232499287,20cyclictest0-21swapper/221:14:202
232499286,21cyclictest0-21swapper/200:30:202
232499286,21cyclictest0-21swapper/200:23:532
232499285,22cyclictest0-21swapper/221:55:202
232499284,23cyclictest0-21swapper/221:15:042
232399288,19cyclictest0-21swapper/122:41:101
2325992715,11cyclictest127602sleep321:39:073
232499277,19cyclictest0-21swapper/221:26:022
232499277,19cyclictest0-21swapper/200:10:322
232499276,20cyclictest0-21swapper/222:33:562
232499276,20cyclictest0-21swapper/220:44:572
232499274,22cyclictest0-21swapper/222:51:182
232399278,18cyclictest0-21swapper/122:36:141
232399277,19cyclictest0-21swapper/123:11:391
232399276,20cyclictest0-21swapper/122:49:161
232399274,22cyclictest0-21swapper/123:52:091
232399273,23cyclictest0-21swapper/100:09:311
2325992615,10cyclictest8002sleep300:30:103
2325992615,10cyclictest251802sleep321:53:013
2325992615,10cyclictest235882sleep322:28:263
2325992615,10cyclictest142522sleep319:35:563
2325992615,10cyclictest101202sleep323:25:323
2325992615,10cyclictest0-21swapper/323:24:313
2325992614,11cyclictest156722sleep323:32:303
232499268,18cyclictest0-21swapper/223:31:172
232499265,20cyclictest0-21swapper/220:55:002
232499265,20cyclictest0-21swapper/220:29:532
232499265,20cyclictest0-21swapper/220:24:532
232399266,19cyclictest0-21swapper/121:50:361
232399265,20cyclictest0-21swapper/121:48:271
2325992515,9cyclictest55442sleep322:07:193
2325992515,9cyclictest260662sleep323:07:473
2325992515,9cyclictest133152sleep300:06:063
2325992515,9cyclictest0-21swapper/323:58:263
2325992515,9cyclictest0-21swapper/323:47:003
2325992515,9cyclictest0-21swapper/323:40:243
2325992515,9cyclictest0-21swapper/319:30:163
2325992515,9cyclictest0-21swapper/300:35:503
2325992514,10cyclictest9076-21sleep20:49:553
2325992514,10cyclictest7822sleep323:52:333
2325992514,10cyclictest76492sleep300:00:173
2325992514,10cyclictest66112sleep321:30:503
2325992514,10cyclictest41152sleep319:12:303
2325992514,10cyclictest290272sleep320:15:023
2325992514,10cyclictest266212sleep320:06:203
2325992514,10cyclictest260672sleep321:16:203
2325992514,10cyclictest210102sleep323:39:113
2325992514,10cyclictest177202sleep322:20:413
2325992514,10cyclictest170142sleep321:01:473
2325992514,10cyclictest166692sleep322:56:403
2325992514,10cyclictest166602sleep321:43:163
2325992514,10cyclictest148992sleep320:56:153
2325992514,10cyclictest106952sleep322:13:443
2325992514,10cyclictest0-21swapper/322:45:193
2325992514,10cyclictest0-21swapper/322:40:223
2325992514,10cyclictest0-21swapper/321:55:183
2325992514,10cyclictest0-21swapper/319:25:103
2325992514,10cyclictest0-21swapper/319:25:093
2325992514,10cyclictest0-21swapper/319:20:183
232499254,20cyclictest0-21swapper/221:05:012
232499254,20cyclictest0-21swapper/219:14:392
232399258,16cyclictest0-21swapper/121:55:461
232399256,18cyclictest0-21swapper/123:23:421
232399256,18cyclictest0-21swapper/121:34:111
232399255,19cyclictest0-21swapper/123:55:091
232399255,19cyclictest0-21swapper/122:50:061
232399255,19cyclictest0-21swapper/121:19:091
232399254,20cyclictest0-21swapper/123:17:161
232399254,20cyclictest0-21swapper/123:01:441
232399254,20cyclictest0-21swapper/100:21:381
232399253,21cyclictest0-21swapper/123:26:441
232399253,21cyclictest0-21swapper/122:01:591
232399253,21cyclictest0-21swapper/121:26:081
232399252,22cyclictest0-21swapper/123:44:131
232399252,22cyclictest0-21swapper/123:06:041
232599247,16cyclictest0-21swapper/323:03:283
232599246,17cyclictest0-21swapper/321:27:173
2325992414,9cyclictest0-21swapper/322:50:253
2325992414,9cyclictest0-21swapper/322:30:223
2325992414,9cyclictest0-21swapper/322:00:043
2325992414,9cyclictest0-21swapper/321:11:213
2325992414,9cyclictest0-21swapper/320:10:233
2325992414,9cyclictest0-21swapper/300:28:403
2325992414,9cyclictest0-21swapper/300:15:573
2325992414,9cyclictest0-21swapper/300:15:563
2325992414,9cyclictest0-21swapper/300:10:203
2325992413,10cyclictest6312sleep320:24:463
2325992413,10cyclictest291082sleep322:35:073
2325992413,10cyclictest285322sleep300:24:523
2325992413,10cyclictest215212sleep321:49:133
2325992413,10cyclictest21102sleep320:25:233
2325992413,10cyclictest192932sleep321:09:233
2325992413,10cyclictest184462sleep319:46:553
232499245,19cyclictest0-21swapper/220:19:522
2324992415,8cyclictest0-21swapper/219:50:192
232399244,19cyclictest0-21swapper/122:57:051
232399244,19cyclictest0-21swapper/122:14:581
232399243,20cyclictest0-21swapper/121:37:161
232399242,21cyclictest0-21swapper/122:30:371
2323992415,8cyclictest0-21swapper/123:45:171
2323992415,8cyclictest0-21swapper/122:20:311
2323992415,8cyclictest0-21swapper/121:24:411
2323992415,8cyclictest0-21swapper/100:13:391
2323992415,8cyclictest0-21swapper/100:00:131
2325992313,9cyclictest0-21swapper/323:11:023
2325992313,9cyclictest0-21swapper/321:20:103
2325992313,9cyclictest0-21swapper/320:35:203
2325992313,9cyclictest0-21swapper/319:55:373
2324992315,8cyclictest0-21swapper/219:40:122
2324992314,8cyclictest0-21swapper/221:00:112
2324992314,8cyclictest0-21swapper/220:45:122
2324992314,8cyclictest0-21swapper/220:10:192
2324992314,8cyclictest0-21swapper/220:00:132
2324992314,8cyclictest0-21swapper/220:00:002
2324992314,8cyclictest0-21swapper/219:25:202
2324992314,8cyclictest0-21swapper/219:25:192
232399233,19cyclictest0-21swapper/100:27:501
232399232,20cyclictest0-21swapper/121:10:071
232399232,20cyclictest0-21swapper/100:35:051
2323992315,8cyclictest0-21swapper/122:19:331
2323992315,8cyclictest0-21swapper/122:05:171
2323992315,8cyclictest0-21swapper/120:50:231
2323992315,8cyclictest0-21swapper/120:05:191
2323992315,8cyclictest0-21swapper/100:30:141
2323992315,8cyclictest0-21swapper/100:15:151
2323992315,8cyclictest0-21swapper/100:15:141
2323992314,8cyclictest0-21swapper/123:35:171
2323992314,8cyclictest0-21swapper/121:05:141
2323992314,8cyclictest0-21swapper/119:55:011
2323992310,12cyclictest0-21swapper/121:40:271
2322992317,5cyclictest0-21swapper/023:42:210
2471622214,7sleep30-21swapper/320:03:003
2325992212,9cyclictest0-21swapper/320:50:163
2325992212,9cyclictest0-21swapper/320:31:053
2325992212,9cyclictest0-21swapper/319:15:243
232499222,19cyclictest0-21swapper/219:20:322
2324992213,8cyclictest0-21swapper/220:55:232
2324992213,8cyclictest0-21swapper/220:35:462
2324992213,8cyclictest0-21swapper/220:30:242
232399224,17cyclictest0-21swapper/120:39:561
2323992214,8cyclictest0-21swapper/120:15:091
2323992214,8cyclictest0-21swapper/119:10:011
2322992215,6cyclictest0-21swapper/000:30:410
2322992211,10cyclictest0-21swapper/023:01:010
2325992112,8cyclictest0-21swapper/320:40:133
2325992112,8cyclictest0-21swapper/319:40:163
2324992114,6cyclictest0-21swapper/219:45:132
2324992114,6cyclictest0-21swapper/219:30:162
2324992112,8cyclictest0-21swapper/219:35:142
2324992112,8cyclictest0-21swapper/219:15:122
232399213,17cyclictest0-21swapper/119:20:321
2323992115,6cyclictest0-21swapper/119:55:181
2323992114,6cyclictest0-21swapper/119:35:131
2323992113,8cyclictest0-21swapper/120:10:141
2322992117,3cyclictest0-21swapper/022:32:530
2322992116,4cyclictest0-21swapper/000:06:400
2322992115,5cyclictest215650irq/31-eth023:34:190
2322992115,5cyclictest215650irq/31-eth022:27:420
2322992114,6cyclictest0-21swapper/021:50:580
2322992113,7cyclictest6251-21ssh23:21:220
2322992111,9cyclictest0-21swapper/020:41:340
2325992013,6cyclictest0-21swapper/319:50:213
2324992014,6cyclictest0-21swapper/220:05:172
232399203,16cyclictest0-21swapper/120:20:191
232399203,16cyclictest0-21swapper/119:45:181
232399203,16cyclictest0-21swapper/119:25:181
232399203,16cyclictest0-21swapper/119:25:181
232399203,16cyclictest0-21swapper/119:15:201
232399202,17cyclictest0-21swapper/119:40:161
2323992014,6cyclictest0-21swapper/121:00:161
2323992012,8cyclictest0-21swapper/120:30:231
2322992016,3cyclictest215650irq/31-eth023:29:470
2322992016,3cyclictest0-21swapper/023:56:390
2322992016,3cyclictest0-21swapper/000:20:120
2322992015,3cyclictest8276-21head22:10:170
2322992015,3cyclictest5647-21df00:35:110
2322992015,3cyclictest18229-21df21:45:120
2322992014,5cyclictest215650irq/31-eth022:57:190
2322992014,5cyclictest215650irq/31-eth022:36:340
2322992014,5cyclictest215650irq/31-eth022:00:080
2322992014,5cyclictest215650irq/31-eth021:59:520
2322992014,5cyclictest215650irq/31-eth021:15:020
2322992014,5cyclictest0-21swapper/019:30:190
2322992013,6cyclictest0-21swapper/022:50:170
2322992013,6cyclictest0-21swapper/022:40:170
2323991913,6cyclictest0-21swapper/120:04:421
2322991916,2cyclictest0-21swapper/023:45:140
2322991915,3cyclictest3389-21runrttasks23:14:100
2322991915,3cyclictest32322-21ssh23:15:140
2322991915,3cyclictest3193-21ssh22:05:120
2322991915,3cyclictest2704-21nscd20:25:380
2322991915,3cyclictest2701-21nscd21:06:010
2322991915,3cyclictest25586-21grep20:05:130
2322991915,3cyclictest25049-21sed20:05:010
2322991915,3cyclictest20418-21ssh00:15:130
2322991915,3cyclictest20418-21ssh00:15:120
2322991915,3cyclictest10283-21ps20:45:180
2322991915,3cyclictest0-21swapper/022:46:300
2322991914,4cyclictest10477-21grep21:35:230
2322991914,3cyclictest6906-21df19:20:220
2322991914,3cyclictest6254-21smart_sdb20:35:210
2322991914,3cyclictest5898-21ntp_states21:30:220
2322991914,3cyclictest29925-21irqstats20:15:150
2322991914,3cyclictest29581-21sed00:25:150
2322991914,3cyclictest24096-21memory23:05:170
2322991914,3cyclictest22408-21users19:55:240
2322991914,3cyclictest20360-21munin-node21:10:150
2322991914,3cyclictest20353-21users19:50:210
2322991914,3cyclictest17709-21diskstats23:35:130
2322991914,3cyclictest16244-21users19:40:240
2322991914,3cyclictest14210-21memory20:55:190
2322991914,3cyclictest13985-21perl21:40:120
2322991914,3cyclictest12829-21sensors_temp22:15:190
2322991913,5cyclictest1962-21chrt21:25:430
2322991910,2cyclictest0-21swapper/021:01:020
232399182,15cyclictest0-21swapper/120:59:051
232399182,15cyclictest0-21swapper/120:40:461
2323991812,6cyclictest0-21swapper/119:30:121
2323991810,8cyclictest0-21swapper/120:25:121
2322991815,2cyclictest186452sleep019:49:120
2322991814,3cyclictest9711-21sendmail_mailst19:25:180
2322991814,3cyclictest9711-21sendmail_mailst19:25:170
2322991814,3cyclictest7814-21latency00:00:170
2322991814,3cyclictest4615-21cpuspeed19:15:110
2322991814,3cyclictest4338-21timerandwakeup20:30:230
2322991814,3cyclictest31876-21smartctl20:20:130
2322991814,3cyclictest28796-21fschecks_time21:20:120
2322991814,3cyclictest16312-21fw_packets00:10:130
2322991814,3cyclictest11414-21awk20:50:120
2322991813,3cyclictest3359-21ntp_states19:10:180
2322991813,3cyclictest31154-21hddtemp_smartct23:50:130
2322991813,3cyclictest27453-21df20:10:130
2322991813,3cyclictest13369-21hddtemp_smartct19:35:130
2322991811,6cyclictest0-21swapper/022:20:070
232399179,8cyclictest0-21swapper/120:46:161
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional