You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-09 - 12:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot7s.osadl.org (updated Fri May 09, 2025 00:43:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2614156212772,22sleep20-21swapper/219:06:242
2614145211973,20sleep10-21swapper/119:06:151
2614179210573,23sleep00-21swapper/019:06:420
2614293210273,21sleep30-21swapper/319:08:093
261458899708,39cyclictest0-21swapper/323:10:253
261458299260,25cyclictest0-21swapper/100:18:421
261458699250,25cyclictest0-21swapper/220:07:552
261458299250,24cyclictest0-21swapper/123:31:041
261458699240,24cyclictest0-21swapper/223:48:372
261458299243,20cyclictest0-21swapper/123:05:151
261457999240,24cyclictest0-21swapper/022:34:470
261457999240,15cyclictest0-21swapper/023:25:010
261458699233,1cyclictest0-21swapper/221:15:002
261457999230,15cyclictest0-21swapper/020:42:290
261457999230,15cyclictest0-21swapper/019:29:330
261458299210,16cyclictest0-21swapper/123:23:011
261458899209,11cyclictest0-21swapper/323:34:173
261458299209,10cyclictest0-21swapper/122:47:031
2614582992018,1cyclictest0-21swapper/121:33:451
2614579992012,8cyclictest0-21swapper/022:25:220
261457999200,1cyclictest0-21swapper/023:17:250
261458899199,4cyclictest0-21swapper/300:16:363
261458299199,4cyclictest0-21swapper/121:15:201
261458299191,17cyclictest2629748-21interrupts19:45:141
2614579991918,1cyclictest0-21swapper/000:16:410
261457999190,4cyclictest0-21swapper/023:52:390
261458899188,10cyclictest0-21swapper/322:22:413
2614588991818,0cyclictest0-21swapper/300:35:123
261458299188,4cyclictest0-21swapper/119:14:481
261458299180,17cyclictest0-21swapper/120:47:341
261457999188,10cyclictest0-21swapper/019:55:250
261457999185,1cyclictest0-21swapper/000:27:300
2614588991714,2cyclictest1051-21snmpd21:02:153
261458899170,11cyclictest0-21swapper/323:00:063
261458699174,13cyclictest0-21swapper/222:02:202
2614586991716,1cyclictest0-21swapper/222:58:332
2614586991711,5cyclictest0-21swapper/219:35:032
2614586991710,7cyclictest0-21swapper/222:13:292
261458699170,3cyclictest0-21swapper/222:50:152
261458699170,17cyclictest0-21swapper/219:50:162
261458699170,17cyclictest0-21swapper/200:07:472
261458699170,16cyclictest0-21swapper/220:30:112
261458299174,1cyclictest311ktimers/122:25:151
2614582991715,1cyclictest0-21swapper/120:06:491
2614582991714,2cyclictest1051-21snmpd23:44:021
2614582991713,4cyclictest0-21swapper/120:00:401
2614579991716,1cyclictest0-21swapper/022:52:120
261457999171,16cyclictest0-21swapper/023:40:160
261457999170,17cyclictest0-21swapper/022:44:340
261458899160,8cyclictest0-21swapper/321:16:423
261458899160,7cyclictest0-21swapper/321:06:393
2614586991614,1cyclictest2730439-21awk00:00:172
2614586991613,2cyclictest1051-21snmpd22:31:052
2614586991612,4cyclictest0-21swapper/222:05:432
261458699161,15cyclictest0-21swapper/222:18:472
2614586991611,5cyclictest0-21swapper/200:12:512
261458699160,6cyclictest0-21swapper/221:38:332
261458699160,16cyclictest0-21swapper/223:54:322
261458699160,16cyclictest0-21swapper/223:36:012
261458699160,16cyclictest0-21swapper/222:40:182
2614582991613,2cyclictest1051-21snmpd21:44:241
261458299160,8cyclictest0-21swapper/119:26:301
261458299160,16cyclictest0-21swapper/120:24:371
261458299160,15cyclictest0-21swapper/100:25:541
2614579991611,5cyclictest0-21swapper/000:10:540
261457999160,7cyclictest0-21swapper/023:35:250
261457999160,7cyclictest0-21swapper/023:03:570
261457999160,7cyclictest0-21swapper/021:07:510
261457999160,16cyclictest0-21swapper/022:13:460
261457999160,16cyclictest0-21swapper/020:45:490
261457999160,16cyclictest0-21swapper/000:00:260
261457999160,15cyclictest0-21swapper/020:50:140
261457999160,15cyclictest0-21swapper/019:10:120
261458899155,10cyclictest0-21swapper/322:26:183
261458899152,13cyclictest0-21swapper/322:15:563
2614588991514,1cyclictest0-21swapper/322:55:173
2614588991511,4cyclictest0-21swapper/323:56:413
2614588991511,4cyclictest0-21swapper/322:37:593
2614588991511,4cyclictest0-21swapper/319:12:273
261458899150,6cyclictest0-21swapper/319:31:513
261458899150,15cyclictest481rcuc/300:25:163
261458899150,15cyclictest0-21swapper/320:54:003
261458899150,15cyclictest0-21swapper/319:47:283
261458699152,13cyclictest0-21swapper/221:10:112
2614586991511,4cyclictest0-21swapper/223:40:042
261458699150,1cyclictest0-21swapper/219:25:182
261458699150,15cyclictest0-21swapper/219:23:092
2614582991514,1cyclictest0-21swapper/122:20:151
2614582991511,4cyclictest0-21swapper/122:37:441
2614582991510,4cyclictest0-21swapper/119:24:541
261458299150,15cyclictest0-21swapper/120:10:511
261458299150,14cyclictest0-21swapper/120:30:201
2614579991514,1cyclictest0-21swapper/019:45:180
2614579991512,2cyclictest1051-21snmpd19:18:050
261457999150,7cyclictest0-21swapper/023:08:240
261457999150,15cyclictest0-21swapper/020:10:170
261458899145,9cyclictest0-21swapper/323:06:003
2614588991411,2cyclictest873-21abrt-dump-journ21:09:593
2614588991410,4cyclictest0-21swapper/320:25:233
261458899140,14cyclictest0-21swapper/322:40:173
261458899140,14cyclictest0-21swapper/300:20:173
261458699149,1cyclictest0-21swapper/221:55:462
261458699145,9cyclictest0-21swapper/220:22:402
2614586991411,2cyclictest1051-21snmpd21:21:072
2614586991410,4cyclictest0-21swapper/220:39:472
2614586991410,4cyclictest0-21swapper/220:39:462
2614586991410,4cyclictest0-21swapper/219:42:592
2614586991410,4cyclictest0-21swapper/219:34:262
261458699140,6cyclictest0-21swapper/222:20:232
261458299144,10cyclictest0-21swapper/122:43:451
261458299143,1cyclictest0-21swapper/121:36:241
261458299143,10cyclictest0-21swapper/122:18:111
2614582991411,2cyclictest1-21systemd22:34:591
2614582991411,2cyclictest1051-21snmpd19:59:451
2614582991411,2cyclictest1051-21snmpd00:13:421
2614582991411,2cyclictest1045-21nmbd22:01:371
2614582991410,4cyclictest0-21swapper/100:09:201
261458299140,1cyclictest0-21swapper/122:50:171
261458299140,13cyclictest0-21swapper/122:55:181
261457999149,1cyclictest0-21swapper/023:31:430
261457999145,9cyclictest0-21swapper/022:07:550
2614579991413,1cyclictest0-21swapper/021:30:210
2614579991412,1cyclictest1045-21nmbd22:15:470
2614579991411,2cyclictest1051-21snmpd20:36:010
2614579991411,2cyclictest1051-21snmpd20:36:010
261457999140,14cyclictest0-21swapper/021:41:180
261458899139,4cyclictest0-21swapper/321:38:573
261458899138,5cyclictest0-21swapper/320:36:233
261458899138,5cyclictest0-21swapper/320:36:223
261458899134,9cyclictest0-21swapper/320:55:143
261458899131,12cyclictest0-21swapper/319:55:213
261458899130,5cyclictest0-21swapper/320:13:363
261458899130,4cyclictest0-21swapper/320:05:363
261458899130,13cyclictest0-21swapper/322:54:583
261458899130,13cyclictest0-21swapper/322:10:163
261458899130,13cyclictest0-21swapper/300:05:143
261458899130,12cyclictest0-21swapper/320:15:113
261458899130,0cyclictest0-21swapper/319:35:213
261458699138,5cyclictest0-21swapper/223:09:132
261458699134,9cyclictest0-21swapper/220:55:292
261458699133,10cyclictest0-21swapper/223:11:422
261458699130,4cyclictest0-21swapper/220:14:182
261458699130,13cyclictest0-21swapper/220:45:212
261458699130,13cyclictest0-21swapper/220:15:122
261458699130,13cyclictest0-21swapper/219:45:142
261458699130,13cyclictest0-21swapper/219:15:132
261458699130,13cyclictest0-21swapper/200:25:132
261458699130,13cyclictest0-21swapper/200:20:182
261458299138,5cyclictest0-21swapper/120:50:391
261458299136,6cyclictest0-21swapper/120:35:141
261458299136,6cyclictest0-21swapper/120:35:131
261458299134,9cyclictest0-21swapper/123:12:071
2614582991312,1cyclictest0-21swapper/119:30:121
2614582991310,2cyclictest1051-21snmpd21:54:071
261458299130,4cyclictest0-21swapper/121:21:371
261458299130,1cyclictest0-21swapper/123:15:101
261458299130,1cyclictest0-21swapper/120:55:201
261458299130,13cyclictest0-21swapper/122:10:111
261458299130,13cyclictest0-21swapper/120:15:181
261458299130,13cyclictest0-21swapper/100:20:181
261457999139,4cyclictest0-21swapper/019:22:150
261457999133,10cyclictest0-21swapper/019:44:360
261457999131,11cyclictest0-21swapper/020:25:010
2614579991310,2cyclictest2704638-21fschecks_time22:55:140
261457999130,13cyclictest0-21swapper/022:35:320
261457999130,13cyclictest0-21swapper/022:20:120
261457999130,13cyclictest0-21swapper/022:00:240
261457999130,13cyclictest0-21swapper/021:35:160
261457999130,13cyclictest0-21swapper/020:05:150
261458899129,2cyclictest1051-21snmpd20:20:493
261458899129,2cyclictest1051-21snmpd00:33:273
261458899128,4cyclictest0-21swapper/321:20:213
261458899127,1cyclictest0-21swapper/322:49:003
261458899123,9cyclictest0-21swapper/323:46:503
261458899122,10cyclictest0-21swapper/322:01:193
2614588991211,1cyclictest0-21swapper/319:23:453
261458899120,3cyclictest0-21swapper/323:38:493
261458899120,12cyclictest0-21swapper/319:15:053
261458899120,11cyclictest2671480-21ntpq21:30:193
261458699129,2cyclictest1051-21snmpd23:29:132
261458699129,2cyclictest1051-21snmpd21:33:072
261458699128,4cyclictest0-21swapper/223:21:012
261458699128,4cyclictest0-21swapper/222:47:242
261458699123,9cyclictest0-21swapper/220:43:502
2614586991211,1cyclictest1051-21snmpd23:16:072
2614586991210,1cyclictest1051-21snmpd20:04:072
261458299129,2cyclictest1051-21snmpd23:45:111
261458299129,2cyclictest1051-21snmpd22:08:011
261458299129,2cyclictest1051-21snmpd20:25:251
261458299129,2cyclictest1051-21snmpd19:50:341
261458299129,2cyclictest1051-21snmpd00:32:031
261457999129,2cyclictest1051-21snmpd23:22:400
261457999129,2cyclictest1051-21snmpd23:11:120
261457999129,2cyclictest1051-21snmpd21:10:080
261457999129,2cyclictest1051-21snmpd20:31:440
2614579991210,2cyclictest2614575-21cyclictest23:55:220
261457999120,12cyclictest0-21swapper/020:15:120
261457999120,12cyclictest0-21swapper/019:35:140
261457999120,12cyclictest0-21swapper/000:35:180
261457999120,11cyclictest2635894-21ntpq20:00:160
261458899119,2cyclictest876-21NetworkManager19:50:103
261458899118,2cyclictest1051-21snmpd23:23:583
261458899118,2cyclictest1051-21snmpd19:43:563
261458899118,2cyclictest1051-21snmpd19:27:233
261458899117,4cyclictest0-21swapper/321:41:213
261458899112,9cyclictest0-21swapper/300:12:453
2614588991110,1cyclictest1051-21snmpd21:52:193
2614588991110,1cyclictest0-21swapper/323:40:223
261458699119,2cyclictest1051-21snmpd23:56:382
261458699119,2cyclictest1051-21snmpd23:32:192
261458699119,1cyclictest1051-21snmpd22:25:422
261458699118,2cyclictest2661505-21needreboot21:05:172
261458699118,2cyclictest1051-21snmpd23:00:152
261458699117,4cyclictest0-21swapper/219:56:452
261458699116,1cyclictest0-21swapper/221:49:112
2614586991110,1cyclictest1051-21snmpd20:27:442
261458699110,4cyclictest2676301-21921:44:582
261458699110,11cyclictest0-21swapper/221:25:452
261458699110,10cyclictest0-21swapper/220:50:152
261458299119,1cyclictest1051-21snmpd23:56:171
261458299119,1cyclictest1051-21snmpd23:39:311
261458299119,1cyclictest1051-21snmpd23:28:461
261458299119,1cyclictest1051-21snmpd21:12:141
261458299119,1cyclictest1045-21nmbd00:37:071
261458299118,2cyclictest1051-21snmpd21:57:341
261458299118,2cyclictest1051-21snmpd21:26:091
261458299118,2cyclictest1051-21snmpd21:00:201
261458299118,2cyclictest1051-21snmpd00:04:191
261458299117,1cyclictest0-21swapper/120:42:531
261458299110,1cyclictest0-21swapper/119:40:151
261458299110,10cyclictest0-21swapper/119:35:181
261457999119,1cyclictest2644701-21dump-pmu-power20:25:000
261457999118,2cyclictest987-21gdbus21:49:590
261457999118,2cyclictest2681777-21unixbench_multi21:55:230
261457999118,2cyclictest2679300-21needreboot21:50:180
261457999117,4cyclictest0-21swapper/021:01:230
261457999110,11cyclictest0-21swapper/021:21:040
261458899109,1cyclictest1051-21snmpd23:16:283
261458899101,0cyclictest0-21swapper/321:56:233
261458899100,10cyclictest0-21swapper/323:50:353
261458899100,10cyclictest0-21swapper/323:29:313
261458899100,10cyclictest0-21swapper/322:34:023
261458899100,10cyclictest0-21swapper/322:05:463
261458899100,10cyclictest0-21swapper/321:25:193
261458899100,10cyclictest0-21swapper/320:47:193
261458899100,10cyclictest0-21swapper/300:04:053
261458699106,1cyclictest0-21swapper/200:15:452
261458699100,10cyclictest0-21swapper/221:04:112
261458699100,10cyclictest0-21swapper/200:38:162
261458299108,1cyclictest0-21swapper/119:19:381
261458299107,2cyclictest2661516-21needreboot21:05:171
261458299107,2cyclictest1051-21snmpd23:51:321
261458299107,2cyclictest1051-21snmpd23:02:481
261458299107,2cyclictest1051-21snmpd21:49:501
261457999108,2cyclictest1051-21snmpd20:55:180
261457999107,2cyclictest1051-21snmpd22:46:210
261457999107,2cyclictest1051-21snmpd21:26:510
261457999100,10cyclictest0-21swapper/023:49:500
261457999100,10cyclictest0-21swapper/021:19:540
261457999100,10cyclictest0-21swapper/000:20:570
26145889996,2cyclictest1051-21snmpd21:46:283
26145889995,4cyclictest0-21swapper/320:01:343
26145869996,2cyclictest2614818-21cpuspeed_turbos19:10:112
26145869995,4cyclictest0-21swapper/221:51:012
26145869990,8cyclictest2741993-21df_abs00:30:132
26145799990,9cyclictest0-21swapper/019:50:280
26145799990,8cyclictest0-21swapper/019:30:130
26145869985,2cyclictest2697136-21ntp_states22:35:182
26145799985,2cyclictest1051-21snmpd00:08:530
26145889975,1cyclictest0-21swapper/320:30:223
26145799970,7cyclictest0-21swapper/000:30:200
26145889965,1cyclictest0-21swapper/320:44:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional