You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-05-28 - 19:03

x86 Intel N455 @1660 MHz, Linux 5.15.49-rt47 (Profile)

Latency plot of system in rack #3, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6 (updated Sun May 28, 2023 12:45:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2816921306,108sleep0528-21snmpd07:05:380
287709910158,36cyclictest528-21snmpd08:50:210
28770998656,17cyclictest14-21ksoftirqd/008:25:170
2834928626,49sleep10-21swapper/107:07:351
28770998467,10cyclictest14-21ksoftirqd/010:05:220
28770998360,11cyclictest14-21ksoftirqd/011:37:070
28770998356,15cyclictest14-21ksoftirqd/007:55:150
28770998158,14cyclictest14-21ksoftirqd/007:30:200
28770998149,19cyclictest14-21ksoftirqd/012:10:210
28770998022,53cyclictest0-21swapper/007:25:160
28770997962,10cyclictest14-21ksoftirqd/007:10:130
28770997950,17cyclictest14-21ksoftirqd/009:15:170
28770997851,18cyclictest14-21ksoftirqd/009:10:190
28770997846,18cyclictest0-21swapper/011:00:250
28770997845,24cyclictest14-21ksoftirqd/008:15:230
28770997646,17cyclictest14-21ksoftirqd/012:35:210
28770997547,18cyclictest0-21swapper/011:25:230
28770997450,13cyclictest0-21swapper/012:20:210
28770997444,17cyclictest14-21ksoftirqd/008:35:270
28770997442,22cyclictest0-21swapper/010:45:270
28770997347,18cyclictest14-21ksoftirqd/008:05:190
28770997346,15cyclictest14-21ksoftirqd/007:45:190
320332720,8chrt0-21swapper/008:55:150
28770997246,18cyclictest14-21ksoftirqd/009:00:250
28770997244,19cyclictest14-21ksoftirqd/010:30:210
28770997242,19cyclictest0-21swapper/007:20:170
28770997242,19cyclictest0-21swapper/007:20:170
280522720,8sleep0171rcuc/011:55:460
28770997146,15cyclictest0-21swapper/009:50:160
28770997112,52cyclictest1304-21seq12:15:210
28780997028,30cyclictest26-21ksoftirqd/110:15:221
28770997041,16cyclictest0-21swapper/009:30:190
2878099694,27cyclictest28799-21apt-get12:00:241
28780996821,33cyclictest26-21ksoftirqd/112:05:181
28770996836,19cyclictest0-21swapper/012:00:230
70062670,7sleep00-21swapper/012:30:450
28770996640,17cyclictest0-21swapper/010:40:190
28770996625,35cyclictest260-21systemd-journal11:46:010
28770996624,34cyclictest260-21systemd-journal07:40:070
28780996427,14cyclictest26-21ksoftirqd/109:20:011
2877099647,17cyclictest13443-21apt-get11:15:200
2877099647,17cyclictest13443-21apt-get11:15:200
28770996441,14cyclictest0-21swapper/008:00:160
28780996314,10cyclictest251rcuc/107:50:051
28770996338,17cyclictest28764-21cyclictest11:05:200
28770996337,16cyclictest0-21swapper/010:25:190
28770996336,20cyclictest28764-21cyclictest10:20:160
28780996124,26cyclictest26-21ksoftirqd/108:30:191
2877099616,48cyclictest0-21swapper/010:35:320
28770996141,14cyclictest260-21systemd-journal10:04:560
28770996135,17cyclictest28764-21cyclictest09:40:200
28770996130,21cyclictest448-21dbus-daemon07:37:090
28770996130,21cyclictest448-21dbus-daemon07:37:090
28770996128,23cyclictest448-21dbus-daemon09:30:000
28770996123,33cyclictest260-21systemd-journal11:41:000
28770996121,31cyclictest0-21swapper/008:30:170
2878099606,23cyclictest26-21ksoftirqd/111:10:321
28780996035,18cyclictest26-21ksoftirqd/109:25:251
2878099603,50cyclictest32333-21taskset12:10:271
28780996034,16cyclictest26-21ksoftirqd/110:25:171
2878099602,50cyclictest30436-21latency_hist07:15:021
2878099602,50cyclictest16214-21latency_hist09:45:011
28770996032,18cyclictest260-21systemd-journal12:26:520
28770996027,24cyclictest448-21dbus-daemon10:00:010
28780995915,11cyclictest251rcuc/112:20:211
28780995912,10cyclictest251rcuc/111:45:301
28780995911,11cyclictest0-21swapper/108:55:161
28770995936,15cyclictest28764-21cyclictest09:45:170
28770995933,18cyclictest25470-21gltestperf11:50:290
28770995933,16cyclictest260-21systemd-journal08:46:110
28770995919,32cyclictest316882chrt07:15:390
28770995913,19cyclictest260-21systemd-journal08:20:140
2878099588,15cyclictest26-21ksoftirqd/110:35:521
2878099583,41cyclictest28146-21head08:40:441
2878099582,20cyclictest26-21ksoftirqd/112:35:201
28780995814,40cyclictest26-21ksoftirqd/110:14:441
28780995811,9cyclictest251rcuc/111:00:251
2877099585,47cyclictest0-21swapper/009:35:380
28770995832,21cyclictest9987-21cron07:50:020
28770995830,19cyclictest4374-21cron09:10:010
28770995829,18cyclictest0-21swapper/010:50:180
28770995827,23cyclictest448-21dbus-daemon12:10:000
2878099578,43cyclictest0-21swapper/107:35:281
2878099578,43cyclictest0-21swapper/107:35:281
2878099578,16cyclictest26-21ksoftirqd/107:40:421
2878099573,16cyclictest25872-21latency08:35:441
2878099572,19cyclictest26-21ksoftirqd/110:55:241
2878099572,17cyclictest26997-21apt-key11:55:031
28780995714,11cyclictest251rcuc/109:45:361
28780995714,10cyclictest251rcuc/109:35:381
28780995714,10cyclictest251rcuc/107:55:181
2877099576,45cyclictest0-21swapper/010:55:380
2877099575,20cyclictest0-21swapper/009:21:560
2877099574,45cyclictest260-21systemd-journal11:30:580
2877099574,26cyclictest469-21rs:main0
28770995731,18cyclictest14-21ksoftirqd/008:40:200
2878099568,16cyclictest26-21ksoftirqd/108:45:441
2878099568,15cyclictest26-21ksoftirqd/107:48:301
2878099568,10cyclictest0-21swapper/111:30:301
28780995624,27cyclictest0-21swapper/108:20:421
2878099562,20cyclictest26-21ksoftirqd/109:50:381
2878099562,16cyclictest20523-21grep09:55:421
28780995615,19cyclictest26-21ksoftirqd/112:30:321
2877099568,43cyclictest0-21swapper/010:10:300
2877099566,45cyclictest0-21swapper/011:20:290
2877099565,41cyclictest26784-21ntp_states10:15:400
2878099559,15cyclictest26-21ksoftirqd/112:25:281
2878099559,15cyclictest26-21ksoftirqd/111:35:321
2878099558,41cyclictest0-21swapper/109:20:341
2878099557,14cyclictest26-21ksoftirqd/110:40:301
2878099556,44cyclictest0-21swapper/109:00:301
2878099555,44cyclictest0-21swapper/111:05:381
2878099555,44cyclictest0-21swapper/107:20:331
2878099555,44cyclictest0-21swapper/107:20:331
28780995522,28cyclictest0-21swapper/111:50:271
28780995519,23cyclictest26-21ksoftirqd/110:46:191
28780995512,10cyclictest251rcuc/107:30:221
28770995524,24cyclictest14-21ksoftirqd/011:10:370
2878099549,14cyclictest26-21ksoftirqd/110:05:291
2878099549,13cyclictest26-21ksoftirqd/111:20:241
2878099548,13cyclictest26-21ksoftirqd/108:05:401
2878099547,15cyclictest26-21ksoftirqd/109:05:421
2878099547,15cyclictest26-21ksoftirqd/107:15:291
2878099546,43cyclictest0-21swapper/108:25:301
2878099545,21cyclictest0-21swapper/110:52:241
2878099543,46cyclictest1301-21apt-get12:15:211
28780995422,13cyclictest26-21ksoftirqd/107:27:291
2878099542,19cyclictest26-21ksoftirqd/108:15:211
28780995417,24cyclictest26-21ksoftirqd/108:53:141
28780995414,11cyclictest251rcuc/111:40:311
28780995411,14cyclictest26-21ksoftirqd/108:15:001
2878099539,14cyclictest26-21ksoftirqd/109:10:411
2878099538,14cyclictest26-21ksoftirqd/111:25:441
2878099538,14cyclictest26-21ksoftirqd/109:30:221
2878099537,14cyclictest26-21ksoftirqd/108:00:171
2878099536,42cyclictest0-21swapper/111:16:171
2878099536,42cyclictest0-21swapper/111:16:171
28780995314,22cyclictest26-21ksoftirqd/110:30:211
2878099525,16cyclictest0-21swapper/110:00:571
2878099522,18cyclictest26-21ksoftirqd/110:20:421
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:473
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
none15:57:472
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional