You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-03-03 - 23:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Sun Mar 03, 2024 12:44:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
46872522720,8sleep342-21ksoftirqd/307:05:363
46813022620,22sleep013-21ksoftirqd/007:05:210
4678302143128,9sleep20-21swapper/207:05:212
46941999982,91cyclictest496037-21sshd08:21:160
5722412940,4sleep00-21swapper/012:00:290
469419999484,6cyclictest472822-21sed07:15:410
46909029357,28sleep10-21swapper/107:07:491
46942899922,82cyclictest0-21swapper/208:21:172
469424999131,10cyclictest1753-21gnome-shell08:46:251
469424999131,10cyclictest1753-21gnome-shell08:46:251
469419999083,4cyclictest0-21swapper/008:02:380
469419998981,5cyclictest0-21swapper/011:55:350
46943299862,58cyclictest1753-21gnome-shell07:25:433
469428998678,5cyclictest0-21swapper/207:15:402
469419998678,5cyclictest0-21swapper/009:33:490
469428998572,8cyclictest880726-21firefox09:33:502
469419998576,5cyclictest0-21swapper/008:48:230
469419998576,5cyclictest0-21swapper/008:48:220
469432998428,16cyclictest42-21ksoftirqd/307:35:433
469432998428,16cyclictest42-21ksoftirqd/307:35:423
469428998477,5cyclictest0-21swapper/208:02:372
469419998476,5cyclictest0-21swapper/007:32:150
469419998375,5cyclictest0-21swapper/007:29:000
4973102820,13sleep3411rcuc/308:25:353
4973102820,13sleep3411rcuc/308:25:343
469432998232,9cyclictest1753-21gnome-shell10:20:003
469428998275,4cyclictest0-21swapper/211:55:362
469419998173,5cyclictest0-21swapper/009:57:360
469419998173,5cyclictest0-21swapper/009:45:420
469432998024,31cyclictest1753-21gnome-shell07:22:373
46943299792,52cyclictest1753-21gnome-shell11:18:433
46943299792,52cyclictest1753-21gnome-shell11:18:433
469432997912,15cyclictest141rcu_preempt07:11:023
469432997912,15cyclictest141rcu_preempt07:11:013
469428997971,5cyclictest0-21swapper/207:32:162
469419997973,4cyclictest0-21swapper/010:07:010
469419997973,4cyclictest0-21swapper/008:17:370
469428997870,5cyclictest0-21swapper/207:29:012
469419997870,5cyclictest0-21swapper/010:10:520
162399780,8rtkit-daemon1622-21rtkit-daemon07:49:572
46943299772,50cyclictest1753-21gnome-shell09:33:403
469428997770,5cyclictest0-21swapper/208:48:232
469428997770,5cyclictest0-21swapper/208:48:222
469428997767,6cyclictest525763-21users09:45:412
469428997718,16cyclictest535813-21ntpq10:15:342
469419997770,5cyclictest0-21swapper/007:39:590
469419997770,5cyclictest0-21swapper/007:39:590
46943299762,17cyclictest1753-21gnome-shell10:08:103
46943299762,11cyclictest1753-21gnome-shell12:00:213
469428997668,5cyclictest0-21swapper/209:57:372
469419997668,5cyclictest0-21swapper/011:50:420
469419997618,50cyclictest881262-21Compositor11:17:510
469419997618,50cyclictest881262-21Compositor11:17:510
469432997537,16cyclictest546988-21munin-run10:50:013
469432997524,47cyclictest1753-21gnome-shell09:39:083
469432997524,47cyclictest1753-21gnome-shell09:39:083
46943299752,10cyclictest1753-21gnome-shell09:56:013
469428997568,5cyclictest0-21swapper/208:17:382
469428997567,5cyclictest0-21swapper/210:07:002
469428997563,8cyclictest569456-21users11:50:412
46942899753,15cyclictest1753-21gnome-shell11:47:382
469424997557,5cyclictest26-21ksoftirqd/109:50:261
46943299743,50cyclictest1753-21gnome-shell09:40:073
46943299743,49cyclictest1753-21gnome-shell09:46:093
46943299743,13cyclictest1753-21gnome-shell07:42:193
46943299742,51cyclictest1753-21gnome-shell11:58:263
46943299742,11cyclictest1753-21gnome-shell08:45:363
46943299742,11cyclictest1753-21gnome-shell08:45:363
46942499743,65cyclictest1753-21gnome-shell12:17:371
469419997466,5cyclictest0-21swapper/007:21:300
46943299732,15cyclictest1753-21gnome-shell09:50:093
46943299732,12cyclictest1753-21gnome-shell08:52:133
46943299732,11cyclictest491173-21munin-run08:10:013
469428997365,5cyclictest0-21swapper/207:39:582
469428997365,5cyclictest0-21swapper/207:39:582
46942499737,40cyclictest1753-21gnome-shell08:33:311
46943299722,12cyclictest1753-21gnome-shell08:44:573
469432997217,15cyclictest1753-21gnome-shell08:37:583
46942899727,23cyclictest1753-21gnome-shell12:00:242
469419997258,10cyclictest526842-21basename09:50:340
46943299713,42cyclictest1753-21gnome-shell07:17:123
46943299712,12cyclictest1753-21gnome-shell08:18:043
469428997164,4cyclictest0-21swapper/210:10:512
469424997156,11cyclictest26-21ksoftirqd/108:29:091
469424997156,11cyclictest26-21ksoftirqd/108:29:081
46943299703,10cyclictest1753-21gnome-shell08:03:363
46943299702,59cyclictest1753-21gnome-shell11:47:373
46943299702,10cyclictest1753-21gnome-shell10:10:143
469428997056,10cyclictest573888-21expr12:05:202
469424997053,6cyclictest26-21ksoftirqd/112:01:001
469424997052,6cyclictest26-21ksoftirqd/109:35:231
469424997052,6cyclictest26-21ksoftirqd/109:35:231
469419997058,8cyclictest1069-21runrttasks09:44:120
469419997012,54cyclictest1753-21gnome-shell08:13:110
469419997011,55cyclictest1753-21gnome-shell08:27:050
469419997011,55cyclictest1753-21gnome-shell08:27:050
46943299692,10cyclictest1753-21gnome-shell11:52:073
469432996912,52cyclictest881251-21Softwar~cThread08:32:293
469428996961,5cyclictest0-21swapper/207:21:312
469424996953,6cyclictest26-21ksoftirqd/108:21:091
469419996912,51cyclictest881251-21Softwar~cThread08:05:360
469419996910,16cyclictest1753-21gnome-shell08:32:580
469419996910,16cyclictest1753-21gnome-shell07:40:180
46943299682,10cyclictest1753-21gnome-shell08:23:293
469428996853,11cyclictest505675-21expr08:50:212
469428996817,11cyclictest1753-21gnome-shell08:26:192
469428996817,11cyclictest1753-21gnome-shell08:26:192
469424996852,6cyclictest26-21ksoftirqd/110:15:311
46941999689,16cyclictest1753-21gnome-shell11:48:130
469419996811,14cyclictest1753-21gnome-shell08:50:410
46942499672,22cyclictest1753-21gnome-shell07:35:281
46942499672,22cyclictest1753-21gnome-shell07:35:271
469419996710,53cyclictest1753-21gnome-shell10:03:490
469419996710,52cyclictest1753-21gnome-shell08:39:020
46942899663,8cyclictest141rcu_preempt08:40:012
46942499666,16cyclictest881251-21Softwar~cThread10:14:521
469424996651,10cyclictest881251-21Softwar~cThread07:24:091
469424996649,12cyclictest881251-21Softwar~cThread07:15:041
469424996647,14cyclictest880970-21Timer09:45:401
469424996634,8cyclictest141rcu_preempt08:10:341
46941999667,54cyclictest880726-21firefox07:11:170
46941999667,54cyclictest880726-21firefox07:11:170
469419996658,5cyclictest0-21swapper/010:47:480
46941999662,22cyclictest502403-21sed08:40:290
46942899652,22cyclictest1753-21gnome-shell10:48:132
46942899652,12cyclictest1753-21gnome-shell08:32:062
469428996513,48cyclictest526888-21cat09:50:352
46942499652,20cyclictest1753-21gnome-shell10:09:041
46942499652,12cyclictest880726-21firefox09:42:451
46941999652,20cyclictest1753-21gnome-shell08:55:130
46942899642,21cyclictest1753-21gnome-shell08:43:502
46942899642,21cyclictest1753-21gnome-shell08:06:032
46942899642,19cyclictest1753-21gnome-shell07:11:572
46942899642,19cyclictest1753-21gnome-shell07:11:572
469424996450,10cyclictest26-21ksoftirqd/108:10:011
469432996345,13cyclictest881251-21Softwar~cThread08:10:383
46942899632,57cyclictest1753-21gnome-shell10:51:132
46942899632,20cyclictest1753-21gnome-shell09:36:202
46942899632,20cyclictest1753-21gnome-shell09:36:192
46942899632,20cyclictest1753-21gnome-shell07:41:262
46942899632,19cyclictest1753-21gnome-shell09:43:292
469424996351,8cyclictest26-21ksoftirqd/112:05:211
469424996346,7cyclictest26-21ksoftirqd/108:19:081
46942499632,19cyclictest1753-21gnome-shell07:10:211
46942499632,19cyclictest1753-21gnome-shell07:10:211
46942499631,6cyclictest141rcu_preempt09:57:501
469424996315,44cyclictest26-21ksoftirqd/109:32:381
46942499631,43cyclictest141rcu_preempt07:41:581
46941999637,52cyclictest574296-21netstat12:05:310
469419996350,8cyclictest880726-21firefox10:15:110
46943299622,19cyclictest1753-21gnome-shell07:30:193
46942899622,18cyclictest1753-21gnome-shell11:18:402
46942899622,18cyclictest1753-21gnome-shell11:18:392
469424996246,6cyclictest26-21ksoftirqd/107:32:201
46942499622,54cyclictest880972-21Socket14:31:441
46942499622,18cyclictest1753-21gnome-shell11:57:031
469419996212,45cyclictest483075-21ntpq07:45:380
469419996211,46cyclictest557619-21chrt11:20:170
46943299612,19cyclictest1753-21gnome-shell12:05:213
469424996146,11cyclictest26-21ksoftirqd/108:50:381
469432996039,14cyclictest881251-21Softwar~cThread10:51:043
469428996044,12cyclictest881251-21Softwar~cThread08:11:552
469428996044,11cyclictest881251-21Softwar~cThread11:20:122
469424996038,18cyclictest475898-21/usr/sbin/munin07:25:341
46941999602,6cyclictest0-21swapper/009:35:230
46941999602,6cyclictest0-21swapper/009:35:230
46942499593,13cyclictest880726-21firefox08:39:541
469424995927,7cyclictest141rcu_preempt08:40:371
46942499592,14cyclictest547723-21irqstats10:50:331
469432995842,11cyclictest438-20systemd-journal11:25:003
46942899582,13cyclictest531216-21runrttasks10:03:402
46942499582,11cyclictest880972-21Socket14:31:441
46941999582,14cyclictest547574-21cstates10:50:220
162399580,9rtkit-daemon1622-21rtkit-daemon09:22:170
46943299572,49cyclictest42-21ksoftirqd/312:17:383
46943299571,34cyclictest1753-21gnome-shell07:45:213
46941999573,10cyclictest0-21swapper/012:17:390
162399570,8rtkit-daemon1622-21rtkit-daemon09:29:061
469432995637,17cyclictest0-21swapper/310:04:293
46942899563,8cyclictest0-21swapper/212:17:382
46942499563,11cyclictest880726-21firefox08:02:551
46942499562,11cyclictest880726-21firefox11:18:201
46942499562,11cyclictest880726-21firefox11:18:201
46942499561,43cyclictest141rcu_preempt11:47:531
46941999565,27cyclictest510887-21expr09:05:200
46942899554,29cyclictest855-21dbus-daemon09:25:002
46942499553,10cyclictest1753-21gnome-shell10:03:131
46942499553,10cyclictest1753-21gnome-shell08:55:051
46942499552,48cyclictest880726-21firefox07:45:131
469428995415,22cyclictest1753-21gnome-shell07:50:092
46941999546,9cyclictest13-21ksoftirqd/009:12:160
5790872510,5sleep10-21swapper/112:20:221
5386652510,6sleep3411rcuc/310:25:253
46942899511,46cyclictest1069-21runrttasks08:55:062
46941999515,19cyclictest519159-21seq09:29:520
5543332500,18sleep234-21ksoftirqd/211:10:202
469419995012,17cyclictest5372962interrupts10:20:300
46941999497,14cyclictest549844-21python310:55:390
46941999495,18cyclictest542390-21expr10:35:240
469432994818,26cyclictest582010-21awk12:30:003
46942899488,12cyclictest34-21ksoftirqd/211:35:402
46942499482,6cyclictest0-21swapper/111:20:031
46941999485,15cyclictest509501-21memory09:00:330
46943299472,42cyclictest0-21swapper/308:55:043
46942899476,17cyclictest34-21ksoftirqd/212:14:132
46942899475,19cyclictest1753-21gnome-shell09:09:492
469428994712,17cyclictest34-21ksoftirqd/212:36:232
469428994710,11cyclictest34-21ksoftirqd/210:55:112
46941999478,11cyclictest561615-40lsb_release11:30:220
46941999477,15cyclictest554747-21latency11:10:310
46942499464,38cyclictest1069-21runrttasks09:00:291
469428994515,15cyclictest1753-21gnome-shell10:20:232
469428994510,20cyclictest34-21ksoftirqd/211:32:222
46941999458,10cyclictest576812-21systemd-run12:15:000
5845352440,16sleep013-21ksoftirqd/012:35:360
46943299445,19cyclictest881251-21Softwar~cThread09:28:283
46942899449,13cyclictest34-21ksoftirqd/209:14:132
46942899446,20cyclictest34-21ksoftirqd/212:33:182
46942899446,20cyclictest34-21ksoftirqd/212:33:172
46941999449,10cyclictest551290-21memory11:00:310
46941999440,16cyclictest1753-21gnome-shell12:31:080
46941999440,16cyclictest1753-21gnome-shell12:31:080
46941999440,16cyclictest1753-21gnome-shell11:25:190
162399440,35rtkit-daemon469410-21cyclictest07:56:012
469432994315,23cyclictest2962348-21rs:main3
469432994313,11cyclictest881251-21Softwar~cThread11:31:113
46942899436,20cyclictest34-21ksoftirqd/209:02:352
469428994319,8cyclictest34-21ksoftirqd/210:43:192
469424994324,14cyclictest580902-21df12:25:251
46941999438,9cyclictest581408-21sensors_temp12:25:400
46941999435,15cyclictest579558-21ntpq12:20:370
46941999435,15cyclictest1753-21gnome-shell07:55:510
469419994335,5cyclictest161rcuc/007:52:090
469419994320,19cyclictest541049-21ntp_states10:30:400
46942899428,16cyclictest34-21ksoftirqd/211:43:082
46942899426,14cyclictest34-21ksoftirqd/212:26:582
46942899426,10cyclictest1753-21gnome-shell12:20:132
469428994234,5cyclictest331rcuc/211:02:192
469428994210,16cyclictest34-21ksoftirqd/209:25:312
469424994230,7cyclictest553889-21sh11:10:001
46941999429,10cyclictest539440-21python310:25:430
162399420,29rtkit-daemon0-21swapper/312:23:193
46943299417,30cyclictest1753-21gnome-shell07:56:473
469432994124,12cyclictest550674-21sshd11:00:163
46942899416,11cyclictest34-21ksoftirqd/210:30:152
46942899416,11cyclictest34-21ksoftirqd/210:29:512
46941999419,15cyclictest13-21ksoftirqd/011:41:440
46941999418,11cyclictest1753-21gnome-shell10:41:270
46941999415,11cyclictest553570-21runrttasks11:06:040
46941999408,13cyclictest13-21ksoftirqd/011:39:140
5620792390,6sleep1251rcuc/111:30:351
46943299393,9cyclictest1753-21gnome-shell11:08:123
469432993925,11cyclictest42-21ksoftirqd/312:30:313
469432993925,11cyclictest42-21ksoftirqd/312:30:313
469432993921,6cyclictest42-21ksoftirqd/311:25:173
469428993931,6cyclictest331rcuc/211:06:592
469428993920,7cyclictest34-21ksoftirqd/209:15:472
469428993913,12cyclictest141rcu_preempt10:39:452
469424993922,13cyclictest511368-21ntp_kernel_err09:05:341
55560323811,12sleep1141rcu_preempt11:14:541
469432993822,12cyclictest516120-21expr09:20:253
46943299382,16cyclictest1753-21gnome-shell12:36:493
469432993813,21cyclictest0-21swapper/310:44:263
469432993812,7cyclictest1753-21gnome-shell11:13:133
46942899387,9cyclictest34-21ksoftirqd/211:25:512
46942499386,6cyclictest141rcu_preempt09:11:571
469424993822,12cyclictest542616-21memory10:35:321
469424993820,13cyclictest565431-21netstat11:40:361
46941999384,10cyclictest514930-21ps09:15:390
5451952370,16sleep126-21ksoftirqd/110:44:551
46943299374,28cyclictest1753-21gnome-shell09:00:093
469432993721,11cyclictest881251-21Softwar~cThread09:09:153
469432993719,13cyclictest438-20systemd-journal12:14:293
162399370,4rtkit-daemon0-21swapper/109:22:501
469432993626,6cyclictest854-21avahi-daemon10:33:273
469432993622,11cyclictest42-21ksoftirqd/310:20:153
469432993618,13cyclictest438-20systemd-journal09:10:153
46943299361,10cyclictest0-21swapper/309:19:513
469424993621,11cyclictest541494-21seq10:32:031
469424993620,12cyclictest582545-21expr12:30:241
469424993620,12cyclictest582545-21expr12:30:231
469432993522,9cyclictest1753-21gnome-shell10:35:423
469432993518,12cyclictest2962348-21rs:main3
469432993515,15cyclictest484513-21df07:50:233
469424993525,7cyclictest563142-21cpuspeed_turbos11:35:231
469424993517,13cyclictest885432-21IPC1
469424993511,19cyclictest881251-21Softwar~cThread07:52:551
5371982341,4sleep10-21swapper/110:20:241
469432993418,12cyclictest563602-21expr11:35:333
469424993419,11cyclictest576343-21cat12:10:441
469424993417,13cyclictest855-21dbus-daemon10:30:011
469424993416,13cyclictest881251-21Softwar~cThread07:57:191
469424993416,13cyclictest559804-21basename11:25:271
469424993413,17cyclictest551222-21latency11:00:301
469424993323,7cyclictest550063-21vmstat10:55:431
469424993319,10cyclictest514391-21expr09:15:231
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional