You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-05-25 - 07:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackcslot7s.osadl.org (updated Sat May 25, 2024 00:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
88389524290,8sleep20-21swapper/219:05:262
95346021090,4sleep20-21swapper/222:05:302
886746991072,8cyclictest141rcu_preempt21:44:011
88674699998,6cyclictest26-21ksoftirqd/119:20:021
88674699965,6cyclictest231irq_work/119:28:321
88674699961,90cyclictest1005907-21cat00:35:231
88674699952,89cyclictest0-21swapper/123:40:031
8983662940,5sleep30-21swapper/319:30:393
886749999483,7cyclictest1-21systemd00:34:592
886749999482,8cyclictest859-21NetworkManager19:26:482
886746999486,5cyclictest0-21swapper/122:44:171
88674699943,7cyclictest0-21swapper/123:50:051
88674699942,88cyclictest0-21swapper/120:08:471
88674699942,88cyclictest0-21swapper/119:57:131
88674699942,88cyclictest0-21swapper/100:30:191
88674699942,88cyclictest0-21swapper/100:20:211
88674699942,88cyclictest0-21swapper/100:15:521
88674699942,20cyclictest1753-21gnome-shell23:35:271
886746999413,75cyclictest881251-21Softwar~cThread20:51:331
886749999382,7cyclictest945202-21taskset21:44:012
88674699932,88cyclictest0-21swapper/119:20:011
88674699932,87cyclictest0-21swapper/123:13:031
88674699932,87cyclictest0-21swapper/123:13:031
88674699932,87cyclictest0-21swapper/100:10:291
88674699932,7cyclictest0-21swapper/119:37:071
88674699932,7cyclictest0-21swapper/119:37:071
88674699932,6cyclictest0-21swapper/123:24:371
88674699932,6cyclictest0-21swapper/123:15:291
88674699932,6cyclictest0-21swapper/100:28:431
88674699932,6cyclictest0-21swapper/100:28:431
886746999284,5cyclictest0-21swapper/123:06:441
886746999284,5cyclictest0-21swapper/119:33:361
88674699922,88cyclictest0-21swapper/123:57:561
88674699922,87cyclictest0-21swapper/123:45:561
88674699922,86cyclictest0-21swapper/123:04:461
88674699922,86cyclictest0-21swapper/122:39:411
88674699922,6cyclictest0-21swapper/100:05:391
886746999211,38cyclictest881251-21Softwar~cThread20:34:101
88557929256,29sleep10-21swapper/119:08:241
886749999184,4cyclictest0-21swapper/223:56:332
886749999178,8cyclictest880726-21firefox23:11:582
886749999178,8cyclictest880726-21firefox23:11:582
88674999912,6cyclictest0-21swapper/219:22:592
886746999184,5cyclictest0-21swapper/123:34:251
886746999183,5cyclictest0-21swapper/119:50:351
88451629171,13sleep00-21swapper/019:05:410
886749999082,5cyclictest0-21swapper/222:42:522
886749999082,5cyclictest0-21swapper/200:10:262
88674999902,85cyclictest0-21swapper/219:19:332
886746999083,5cyclictest0-21swapper/120:01:191
886746999082,5cyclictest0-21swapper/120:35:151
88674699903,15cyclictest980950-21cpuspeed23:25:141
886746998981,5cyclictest0-21swapper/119:49:171
88674699892,22cyclictest1753-21gnome-shell21:34:221
886746998880,5cyclictest0-21swapper/122:49:031
886746998880,5cyclictest0-21swapper/122:49:031
886746998779,5cyclictest0-21swapper/122:03:521
88674699872,19cyclictest1753-21gnome-shell21:36:091
88674699862,21cyclictest1753-21gnome-shell20:10:521
88674699862,20cyclictest1753-21gnome-shell21:28:591
886749998577,5cyclictest0-21swapper/223:24:502
886749998577,5cyclictest0-21swapper/220:27:552
886749998577,5cyclictest0-21swapper/220:04:052
886749998577,5cyclictest0-21swapper/219:11:562
886749998577,5cyclictest0-21swapper/200:06:272
886746998579,4cyclictest0-21swapper/100:04:371
886746998575,7cyclictest26-21ksoftirqd/120:21:001
88674699852,18cyclictest1753-21gnome-shell19:11:111
88674699852,15cyclictest1753-21gnome-shell20:17:051
886740998569,12cyclictest881251-21Softwar~cThread20:01:130
886749998476,5cyclictest0-21swapper/223:41:552
886749998476,5cyclictest0-21swapper/223:09:192
886749998476,5cyclictest0-21swapper/200:27:212
886749998476,5cyclictest0-21swapper/200:27:212
886749998476,5cyclictest0-21swapper/200:19:062
88674699843,10cyclictest917592-21df20:25:151
88496728459,19sleep30-21swapper/319:06:583
88675399833,44cyclictest1753-21gnome-shell20:00:523
886749998375,5cyclictest0-21swapper/219:57:032
88674699832,16cyclictest1753-21gnome-shell21:45:111
9634972820,7sleep01753-21gnome-shell22:35:150
88675399822,45cyclictest1753-21gnome-shell20:38:033
886749998275,5cyclictest0-21swapper/223:16:122
886749998274,5cyclictest0-21swapper/200:24:492
886749998274,4cyclictest854-21avahi-daemon23:48:572
88674699823,11cyclictest880726-21firefox20:45:451
88674699822,8cyclictest962946-21munin-plugin-st22:35:001
886749998173,5cyclictest0-21swapper/223:04:162
886749998173,5cyclictest0-21swapper/222:37:072
88675399802,19cyclictest1753-21gnome-shell20:24:313
886749998073,4cyclictest0-21swapper/219:38:492
886749998073,4cyclictest0-21swapper/219:38:492
886740998061,6cyclictest13-21ksoftirqd/019:25:120
9067072790,6sleep31753-21gnome-shell19:55:023
88675399792,19cyclictest1753-21gnome-shell19:39:183
88675399792,19cyclictest1753-21gnome-shell19:39:173
886749997972,4cyclictest0-21swapper/223:25:572
886749997971,5cyclictest0-21swapper/222:45:422
886749997971,5cyclictest0-21swapper/222:45:422
886749997971,5cyclictest0-21swapper/221:22:092
88674699792,13cyclictest938130-21chrt21:22:301
886740997961,5cyclictest13-21ksoftirqd/019:35:180
886740997961,5cyclictest13-21ksoftirqd/019:35:180
886749997870,5cyclictest0-21swapper/221:28:492
886749997867,7cyclictest1005877-21df00:35:182
886746997813,51cyclictest141rcu_preempt21:19:411
88675399772,19cyclictest1753-21gnome-shell22:40:143
886753997717,18cyclictest881251-21Softwar~cThread19:15:283
88675399771,51cyclictest1753-21gnome-shell23:16:353
88675399771,24cyclictest1069-21runrttasks21:28:363
886749997769,5cyclictest0-21swapper/219:53:422
88674699772,10cyclictest1753-21gnome-shell20:40:271
886740997758,14cyclictest922041-21users20:35:420
886753997622,50cyclictest42-21ksoftirqd/300:05:403
886749997668,5cyclictest0-21swapper/223:50:062
886749997668,5cyclictest0-21swapper/221:39:472
886740997626,45cyclictest1753-21gnome-shell00:21:520
886753997559,12cyclictest855-21dbus-daemon19:25:443
88675399752,15cyclictest1753-21gnome-shell23:58:113
88675399752,11cyclictest880726-21firefox23:38:443
886753997520,8cyclictest42-21ksoftirqd/320:10:473
886749997524,10cyclictest881251-21Softwar~cThread19:33:162
886740997526,44cyclictest13-21ksoftirqd/020:22:130
88675399748,48cyclictest141rcu_preempt21:35:323
88675399747,44cyclictest940073-21sh21:34:553
88675399743,47cyclictest1753-21gnome-shell00:32:223
886740997455,14cyclictest13-21ksoftirqd/023:52:030
886740997423,46cyclictest1753-21gnome-shell23:20:370
88675399738,11cyclictest141rcu_preempt21:45:003
88675399736,11cyclictest141rcu_preempt23:40:163
886753997338,8cyclictest1753-21gnome-shell23:25:323
88675399733,12cyclictest1753-21gnome-shell23:24:513
88675399733,11cyclictest880726-21firefox20:16:433
88675399733,10cyclictest1753-21gnome-shell00:35:393
88675399732,45cyclictest1753-21gnome-shell22:39:593
88675399732,13cyclictest1753-21gnome-shell23:14:563
88675399732,13cyclictest1753-21gnome-shell23:14:563
88675399732,11cyclictest1753-21gnome-shell23:06:193
886740997362,7cyclictest1753-21gnome-shell20:26:070
886740997361,8cyclictest1753-21gnome-shell23:38:070
886740997326,44cyclictest0-21swapper/023:47:540
886753997239,8cyclictest1753-21gnome-shell00:18:123
88675399723,47cyclictest1753-21gnome-shell19:23:433
88675399723,15cyclictest141rcu_preempt20:40:233
88675399722,49cyclictest1753-21gnome-shell22:47:403
88675399722,49cyclictest1753-21gnome-shell22:47:403
88675399722,16cyclictest141rcu_preempt00:20:313
88675399722,13cyclictest1753-21gnome-shell00:28:363
88675399722,13cyclictest1753-21gnome-shell00:28:363
886753997220,11cyclictest1753-21gnome-shell19:49:023
88675399721,14cyclictest141rcu_preempt20:50:133
886749997217,50cyclictest881251-21Softwar~cThread20:30:282
886740997262,6cyclictest13-21ksoftirqd/022:45:410
886740997262,6cyclictest13-21ksoftirqd/022:45:410
886740997261,7cyclictest1753-21gnome-shell19:21:220
886753997158,8cyclictest1753-21gnome-shell23:04:183
88675399713,10cyclictest1753-21gnome-shell20:30:203
88675399712,45cyclictest1753-21gnome-shell23:48:163
88675399712,11cyclictest1753-21gnome-shell19:55:033
886749997165,4cyclictest0-21swapper/220:08:562
88674099713,62cyclictest881251-21Softwar~cThread21:35:430
886740997122,45cyclictest1753-21gnome-shell20:45:490
88675399705,46cyclictest1753-21gnome-shell23:50:113
88675399703,48cyclictest1753-21gnome-shell22:33:563
88675399703,46cyclictest1753-21gnome-shell21:22:313
88675399703,46cyclictest1753-21gnome-shell20:48:503
88675399702,45cyclictest887187-21sshd19:10:163
88675399702,12cyclictest1753-21gnome-shell00:00:033
88675399702,10cyclictest1753-21gnome-shell21:19:033
88675399702,10cyclictest1753-21gnome-shell00:12:153
886749997011,53cyclictest1753-21gnome-shell20:20:162
886740997055,11cyclictest1069-21runrttasks19:48:550
886740997044,16cyclictest13-21ksoftirqd/019:10:420
88674099702,38cyclictest141rcu_preempt21:19:410
886740997020,46cyclictest1753-21gnome-shell00:33:550
886740997019,9cyclictest1753-21gnome-shell20:05:390
88675399693,46cyclictest1753-21gnome-shell20:28:203
88675399692,10cyclictest1753-21gnome-shell20:06:333
88675399684,11cyclictest141rcu_preempt23:33:543
88675399682,44cyclictest881251-21Softwar~cThread22:04:503
886749996811,15cyclictest881251-21Softwar~cThread20:38:132
886740996853,11cyclictest897918-21interrupts19:30:270
886740996819,8cyclictest938055-21runrttasks21:21:340
886740996816,41cyclictest1753-21gnome-shell20:50:310
886749996755,8cyclictest34-21ksoftirqd/220:19:082
886749996750,12cyclictest881331-21Privileged14:31:442
886749996717,46cyclictest34-21ksoftirqd/223:36:182
886749996713,9cyclictest1753-21gnome-shell19:49:032
886740996759,5cyclictest0-21swapper/023:06:450
88674099672,50cyclictest0-21swapper/023:17:460
88674099672,19cyclictest1753-21gnome-shell21:32:250
886740996716,9cyclictest1753-21gnome-shell19:54:380
886749996656,7cyclictest0-21swapper/222:33:522
886749996613,49cyclictest1753-21gnome-shell20:49:272
886749996611,50cyclictest913438-21chrt20:14:372
886740996658,5cyclictest0-21swapper/000:36:200
886740996649,5cyclictest141rcu_preempt22:41:210
88674099662,8cyclictest141rcu_preempt00:00:240
88674099662,58cyclictest1753-21gnome-shell23:10:050
88674099662,58cyclictest1753-21gnome-shell23:10:050
88674099662,54cyclictest1753-21gnome-shell20:41:030
88674099662,21cyclictest1753-21gnome-shell19:19:170
886740996615,9cyclictest1753-21gnome-shell22:04:410
886749996547,14cyclictest923032-21cstates20:40:142
88674099652,58cyclictest1753-21gnome-shell20:18:430
88674099652,19cyclictest1753-21gnome-shell20:30:370
886749996456,5cyclictest0-21swapper/223:34:092
886746996439,21cyclictest0-21swapper/122:50:071
886740996456,5cyclictest0-21swapper/000:25:550
886740996456,5cyclictest0-21swapper/000:25:550
88674099642,58cyclictest1753-21gnome-shell21:42:030
88674099642,20cyclictest1753-21gnome-shell20:13:070
88674099642,19cyclictest1753-21gnome-shell21:29:390
886740996415,44cyclictest13-21ksoftirqd/023:04:540
88674999632,19cyclictest1753-21gnome-shell21:45:282
886749996311,46cyclictest881356-21Isolated14:31:442
886740996354,6cyclictest0-21swapper/019:56:400
886740996354,6cyclictest0-21swapper/000:12:140
886740996343,6cyclictest141rcu_preempt23:58:170
88674099632,55cyclictest1753-21gnome-shell21:45:160
88674099632,19cyclictest1753-21gnome-shell23:40:300
162399620,10rtkit-daemon1622-21rtkit-daemon20:59:092
88674999613,46cyclictest1753-21gnome-shell21:19:112
886749996111,45cyclictest926311-21/usr/sbin/munin20:50:122
88674099612,7cyclictest141rcu_preempt00:08:380
162399610,43rtkit-daemon1753-21gnome-shell22:50:250
886749996053,4cyclictest0-21swapper/222:50:092
886740996027,15cyclictest0-21swapper/000:18:050
88674099602,53cyclictest1753-21gnome-shell23:34:460
886740996015,29cyclictest13-21ksoftirqd/022:35:010
886740996013,43cyclictest13-21ksoftirqd/023:26:070
886746995920,34cyclictest957777-21cut22:20:011
886746995920,34cyclictest934032-21ls21:10:281
886746995920,34cyclictest934032-21ls21:10:281
88675399572,14cyclictest945302-21apt-get21:45:073
886749995745,7cyclictest880726-21firefox22:03:522
886746995713,40cyclictest26-21ksoftirqd/121:55:141
88674699561,50cyclictest875-21polkitd19:43:071
886746995512,38cyclictest961268-21cut22:30:011
886746995512,38cyclictest961268-21cut22:30:011
886749995430,20cyclictest1753-21gnome-shell19:40:272
886746995414,35cyclictest970827-21irqstats22:55:271
88674699532,18cyclictest1753-21gnome-shell22:06:161
886746995318,30cyclictest928080-21cpu20:55:131
886746995313,34cyclictest930525-21netstat21:00:281
88674699531,11cyclictest948843-21seq21:54:251
162399530,43rtkit-daemon881251-21Softwar~cThread21:04:433
88674699512,7cyclictest958372-21df_inode22:20:181
88674699512,7cyclictest955614-21users22:10:371
88675399502,7cyclictest968602-21apt22:50:113
88674699506,7cyclictest881251-21Softwar~cThread21:08:421
88674999497,25cyclictest1753-21gnome-shell21:06:592
162399480,37rtkit-daemon0-21swapper/022:06:350
886753994720,8cyclictest1753-21gnome-shell21:05:143
88674999473,17cyclictest1753-21gnome-shell22:10:072
88674999463,27cyclictest1753-21gnome-shell21:10:372
88674999463,27cyclictest1753-21gnome-shell21:10:372
88675399459,18cyclictest1753-21gnome-shell22:13:563
88674999453,16cyclictest1753-21gnome-shell22:15:542
88674999450,20cyclictest949318-21cpuspeed_turbos21:55:122
886740994528,12cyclictest881251-21Softwar~cThread22:26:500
886740994528,12cyclictest881251-21Softwar~cThread22:26:500
886749994421,19cyclictest2962348-21rs:main2
88674999441,17cyclictest1753-21gnome-shell22:57:452
88675399431,38cyclictest1753-21gnome-shell22:09:463
88674999433,16cyclictest1753-21gnome-shell22:30:012
88674999433,16cyclictest1753-21gnome-shell22:30:012
88674099432,11cyclictest1753-21gnome-shell22:18:580
88674999426,15cyclictest1753-21gnome-shell21:53:162
88674999403,16cyclictest1753-21gnome-shell22:20:572
886740994029,6cyclictest1753-21gnome-shell21:00:360
886753993926,8cyclictest880726-21firefox21:51:103
886753993922,13cyclictest933799-21fw_packets21:10:213
886753993922,13cyclictest933799-21fw_packets21:10:213
88674099394,14cyclictest1358-1kworker/u9:122:24:090
88674099392,33cyclictest1753-21gnome-shell22:12:240
886740993915,8cyclictest1753-21gnome-shell19:43:070
886753993823,11cyclictest42-21ksoftirqd/319:40:193
88674099382,31cyclictest880726-21firefox21:52:440
886753993723,9cyclictest1753-21gnome-shell22:25:183
886753993723,9cyclictest1753-21gnome-shell22:25:183
88675399372,15cyclictest1753-21gnome-shell22:16:163
886740993721,12cyclictest932998-21update-motd-fsc21:09:100
886740993721,11cyclictest934998-21date21:15:010
886740993721,11cyclictest934998-21date21:15:010
162399370,25rtkit-daemon0-21swapper/021:55:560
886753993623,9cyclictest1753-21gnome-shell22:55:563
88675399361,15cyclictest1753-21gnome-shell20:58:363
162399360,25rtkit-daemon0-21swapper/022:57:010
886753993520,11cyclictest958334-21expr22:20:163
886753993520,11cyclictest949653-21awk21:55:203
88674099359,12cyclictest141rcu_preempt20:56:100
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional