You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-26 - 23:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot7s.osadl.org (updated Fri Apr 26, 2024 00:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1728963211968,20sleep20-21swapper/219:08:282
1728941211670,20sleep00-21swapper/019:08:090
1728723211366,20sleep30-21swapper/319:05:283
1728753210275,20sleep10-21swapper/119:05:491
1729239993916,22cyclictest0-21swapper/320:32:033
1729234992914,15cyclictest0-21swapper/223:05:172
172923999260,25cyclictest0-21swapper/323:35:143
172922999260,17cyclictest0-21swapper/000:13:060
1729234992512,13cyclictest0-21swapper/222:05:182
172923299250,24cyclictest0-21swapper/123:01:581
172923999240,15cyclictest0-21swapper/320:09:583
172923499244,4cyclictest0-21swapper/222:41:332
1729234992423,1cyclictest0-21swapper/223:47:032
1729232992312,11cyclictest0-21swapper/121:05:121
1729234992212,10cyclictest0-21swapper/219:10:192
172923299217,13cyclictest0-21swapper/119:10:201
172923999207,13cyclictest0-21swapper/322:05:193
172923299206,13cyclictest0-21swapper/119:30:141
1729239991912,7cyclictest0-21swapper/323:00:123
172923499190,3cyclictest0-21swapper/219:36:132
172923499190,3cyclictest0-21swapper/219:36:122
172923299195,13cyclictest0-21swapper/122:04:111
172923299190,3cyclictest0-21swapper/121:45:051
1729234991815,2cyclictest718066-21llvmpipe-323:38:592
172923499180,18cyclictest0-21swapper/200:31:032
172923299188,4cyclictest1848987-21taskset00:09:451
172923299181,16cyclictest0-21swapper/122:50:541
172923299180,2cyclictest0-21swapper/122:06:441
172923299180,17cyclictest0-21swapper/121:39:031
172922999180,3cyclictest0-21swapper/021:06:130
172923999176,1cyclictest0-21swapper/323:19:493
172923999175,12cyclictest0-21swapper/319:10:203
1729239991713,4cyclictest0-21swapper/322:39:273
1729234991714,2cyclictest1026-21snmpd20:27:502
172923499170,17cyclictest0-21swapper/221:22:062
172923499170,16cyclictest0-21swapper/200:10:242
172923299170,8cyclictest0-21swapper/121:51:211
172923299170,16cyclictest0-21swapper/123:05:171
172923299170,16cyclictest0-21swapper/121:55:131
172923299170,16cyclictest0-21swapper/120:55:081
172922999170,16cyclictest0-21swapper/023:29:100
172922999170,16cyclictest0-21swapper/000:08:330
172923999167,9cyclictest0-21swapper/300:12:153
172923999162,13cyclictest0-21swapper/322:31:183
1729239991612,4cyclictest0-21swapper/319:54:483
1729239991612,4cyclictest0-21swapper/319:47:553
1729239991612,4cyclictest0-21swapper/319:40:163
172923999160,7cyclictest0-21swapper/322:20:473
172923999160,15cyclictest0-21swapper/319:35:373
172923999160,15cyclictest0-21swapper/319:35:363
172923999160,14cyclictest0-21swapper/322:15:173
172923499160,6cyclictest0-21swapper/222:54:402
172923499160,16cyclictest0-21swapper/223:42:472
172923499160,16cyclictest0-21swapper/223:14:312
172923499160,16cyclictest0-21swapper/221:38:402
1729232991615,1cyclictest0-21swapper/100:16:421
172923299160,16cyclictest0-21swapper/122:33:301
172923299160,16cyclictest0-21swapper/122:22:321
172923299160,16cyclictest0-21swapper/120:45:191
172923299160,16cyclictest0-21swapper/120:07:551
172923299160,16cyclictest0-21swapper/119:40:271
172923299160,16cyclictest0-21swapper/119:15:051
172923299160,16cyclictest0-21swapper/100:36:091
172923299160,15cyclictest0-21swapper/119:25:171
172922999166,9cyclictest0-21swapper/020:32:410
1729229991611,1cyclictest0-21swapper/020:25:260
1729229991611,1cyclictest0-21swapper/020:05:010
172922999160,7cyclictest0-21swapper/023:22:580
172922999160,15cyclictest0-21swapper/021:16:000
172923999152,5cyclictest0-21swapper/321:04:373
1729239991514,1cyclictest0-21swapper/323:50:163
1729239991514,1cyclictest0-21swapper/323:50:163
1729239991513,1cyclictest1026-21snmpd22:03:143
172923999150,6cyclictest0-21swapper/321:38:373
172923999150,6cyclictest0-21swapper/319:29:443
172923499157,8cyclictest0-21swapper/220:56:052
172923499156,9cyclictest0-21swapper/222:23:292
172923499156,9cyclictest0-21swapper/220:02:112
1729234991512,2cyclictest1026-21snmpd00:00:472
172923499150,7cyclictest0-21swapper/221:13:122
172923499150,1cyclictest0-21swapper/221:15:192
172923499150,15cyclictest0-21swapper/200:24:292
1729232991513,1cyclictest1026-21snmpd21:02:001
1729232991510,5cyclictest0-21swapper/123:13:131
172923299150,15cyclictest0-21swapper/120:24:161
172923299150,15cyclictest0-21swapper/120:00:141
172923299150,14cyclictest0-21swapper/122:40:181
172923299150,14cyclictest0-21swapper/119:55:171
172922999155,10cyclictest0-21swapper/022:04:420
172922999152,1cyclictest0-21swapper/021:11:300
1729229991511,4cyclictest0-21swapper/023:32:050
1729229991511,4cyclictest0-21swapper/023:15:310
172922999150,7cyclictest0-21swapper/021:28:180
172922999150,6cyclictest0-21swapper/022:06:470
172922999150,6cyclictest0-21swapper/000:24:390
172922999150,15cyclictest0-21swapper/021:03:270
172923999145,9cyclictest0-21swapper/321:57:113
172923999145,4cyclictest0-21swapper/320:03:223
172923999143,10cyclictest1766631-21ntpq20:40:233
1729239991413,1cyclictest1026-21snmpd23:25:163
1729239991410,4cyclictest0-21swapper/321:12:393
172923999140,6cyclictest0-21swapper/322:55:363
172923999140,6cyclictest0-21swapper/322:52:033
172923999140,6cyclictest0-21swapper/319:59:233
172923499149,1cyclictest0-21swapper/221:32:202
172923499145,9cyclictest0-21swapper/223:56:472
172923499145,9cyclictest0-21swapper/223:01:012
1729234991413,1cyclictest1026-21snmpd19:24:542
1729234991413,1cyclictest0-21swapper/221:40:102
1729234991412,1cyclictest0-21swapper/220:35:192
1729234991410,4cyclictest0-21swapper/222:47:182
1729234991410,4cyclictest0-21swapper/219:47:402
1729234991410,1cyclictest0-21swapper/220:24:012
172923499140,6cyclictest0-21swapper/220:47:202
172923499140,1cyclictest0-21swapper/220:50:202
172923499140,13cyclictest0-21swapper/222:30:142
172923499140,13cyclictest0-21swapper/220:40:102
172923299143,10cyclictest0-21swapper/120:43:331
172923299140,5cyclictest0-21swapper/120:29:561
172922999145,9cyclictest0-21swapper/000:25:150
1729229991411,2cyclictest1026-21snmpd19:42:330
1729229991410,4cyclictest0-21swapper/021:58:280
1729229991410,4cyclictest0-21swapper/020:50:570
172922999140,6cyclictest0-21swapper/020:57:570
172922999140,6cyclictest0-21swapper/020:47:020
172922999140,14cyclictest0-21swapper/021:50:460
112099140,0ntpd0-21swapper/222:10:152
172923999134,9cyclictest0-21swapper/319:33:103
172923999133,9cyclictest0-21swapper/319:24:033
172923999130,13cyclictest0-21swapper/320:40:003
172923499139,4cyclictest0-21swapper/223:17:462
172923499139,4cyclictest0-21swapper/219:51:242
172923499139,4cyclictest0-21swapper/200:17:182
172923499134,9cyclictest0-21swapper/221:02:422
1729234991312,1cyclictest0-21swapper/221:50:102
1729234991312,1cyclictest0-21swapper/221:25:192
1729234991312,1cyclictest0-21swapper/221:05:212
1729234991312,1cyclictest0-21swapper/220:05:212
172923499130,5cyclictest0-21swapper/219:26:152
172923499130,13cyclictest0-21swapper/222:00:232
172923499130,13cyclictest0-21swapper/220:30:192
172923499130,13cyclictest0-21swapper/220:15:162
172923499130,13cyclictest0-21swapper/220:10:142
172923299138,5cyclictest0-21swapper/120:51:221
172923299133,10cyclictest0-21swapper/122:37:241
1729232991311,1cyclictest1026-21snmpd22:14:381
172923299130,13cyclictest0-21swapper/123:30:141
172923299130,13cyclictest0-21swapper/120:10:231
172922999135,8cyclictest0-21swapper/019:35:310
172922999135,8cyclictest0-21swapper/019:35:310
1729229991312,1cyclictest0-21swapper/023:02:400
1729229991312,1cyclictest0-21swapper/021:32:040
1729229991312,1cyclictest0-21swapper/019:45:250
1729229991310,2cyclictest1026-21snmpd23:46:320
1729229991310,2cyclictest1026-21snmpd19:15:450
172922999130,5cyclictest0-21swapper/021:40:370
172922999130,1cyclictest0-21swapper/022:55:170
172922999130,1cyclictest0-21swapper/022:50:210
172922999130,13cyclictest0-21swapper/021:35:170
172922999130,13cyclictest0-21swapper/019:20:200
172923999129,2cyclictest1026-21snmpd23:43:023
172923999129,2cyclictest1026-21snmpd23:09:253
172923999123,9cyclictest0-21swapper/321:30:233
172923999123,9cyclictest0-21swapper/320:47:113
172923999123,9cyclictest0-21swapper/320:23:263
172923999122,9cyclictest0-21swapper/321:51:133
172923999122,9cyclictest0-21swapper/321:49:133
172923999122,9cyclictest0-21swapper/320:15:103
1729239991211,1cyclictest0-21swapper/322:25:473
172923999120,11cyclictest0-21swapper/320:10:133
172923499129,2cyclictest1026-21snmpd23:26:312
172923499129,2cyclictest1026-21snmpd23:23:462
172923499123,9cyclictest0-21swapper/219:55:282
1729234991211,1cyclictest0-21swapper/219:19:352
1729234991210,1cyclictest1026-21snmpd23:52:322
1729234991210,1cyclictest1026-21snmpd23:52:322
172923499120,3cyclictest0-21swapper/200:09:082
172923299129,2cyclictest1026-21snmpd21:33:411
172923299129,2cyclictest1026-21snmpd19:46:011
172923299129,2cyclictest1026-21snmpd19:22:481
172923299124,8cyclictest0-21swapper/121:20:151
172923299123,9cyclictest0-21swapper/123:25:461
1729232991211,1cyclictest0-21swapper/119:35:211
1729232991211,1cyclictest0-21swapper/119:35:211
1729232991210,2cyclictest718065-21llvmpipe-222:17:581
1729232991210,1cyclictest1026-21snmpd21:18:541
172923299120,12cyclictest0-21swapper/123:49:591
172923299120,12cyclictest0-21swapper/120:15:161
172922999129,2cyclictest1026-21snmpd00:33:270
172922999127,1cyclictest0-21swapper/020:21:550
172922999123,9cyclictest0-21swapper/020:35:140
1729229991210,1cyclictest1026-21snmpd19:13:300
172922999120,12cyclictest0-21swapper/019:55:160
172922999120,12cyclictest0-21swapper/000:35:160
172923999119,1cyclictest1026-21snmpd21:43:553
172923999119,1cyclictest1026-21snmpd00:39:393
172923999119,1cyclictest1026-21snmpd00:27:153
172923999118,2cyclictest1770664-21pmu-power20:50:213
172923999118,2cyclictest1026-21snmpd20:26:533
172923999118,2cyclictest1026-21snmpd00:06:293
172923999111,9cyclictest0-21swapper/319:15:233
1729239991110,1cyclictest0-21swapper/323:30:143
172923999110,1cyclictest0-21swapper/321:16:193
172923499118,2cyclictest1026-21snmpd23:31:442
172923499118,2cyclictest1026-21snmpd21:58:042
172923499118,2cyclictest1026-21snmpd21:45:172
172923499118,2cyclictest1026-21snmpd19:40:552
1729234991110,1cyclictest0-21swapper/222:15:222
172923299119,1cyclictest1026-21snmpd21:40:401
172923299119,1cyclictest1026-21snmpd21:29:191
172923299119,1cyclictest1018-21nmbd22:49:441
172923299118,2cyclictest1026-21snmpd23:24:041
172923299118,2cyclictest1026-21snmpd20:35:111
172923299118,2cyclictest1026-21snmpd00:34:181
172923299117,4cyclictest0-21swapper/123:37:471
172923299117,4cyclictest0-21swapper/119:51:301
172923299113,8cyclictest0-21swapper/121:12:091
172923299110,10cyclictest718066-21llvmpipe-323:16:581
172922999119,2cyclictest1026-21snmpd20:41:510
172922999119,1cyclictest1026-21snmpd22:31:270
172922999119,1cyclictest1026-21snmpd20:18:020
172922999119,1cyclictest1026-21snmpd19:29:150
172922999118,2cyclictest795-21systemd-machine22:19:590
172922999118,2cyclictest1026-21snmpd19:32:330
172922999112,7cyclictest0-21swapper/021:45:250
172922999111,9cyclictest1824758-21users23:05:250
172922999110,10cyclictest1816281-21ntpq22:45:180
172922999110,10cyclictest0-21swapper/022:25:140
112099110,0ntpd0-21swapper/100:25:191
172923999109,1cyclictest1026-21snmpd23:55:203
172923999109,1cyclictest1026-21snmpd23:10:403
172923999108,1cyclictest1026-21snmpd00:19:333
172923999107,2cyclictest1816388-21pmu-power22:45:213
172923999107,2cyclictest1026-21snmpd21:05:313
172923999107,2cyclictest1026-21snmpd00:04:263
172923999106,1cyclictest0-21swapper/320:56:473
172923999105,1cyclictest0-21swapper/300:24:093
172923999100,4cyclictest0-21swapper/321:27:423
172923999100,10cyclictest0-21swapper/323:49:593
172923999100,10cyclictest0-21swapper/322:11:513
172923499109,1cyclictest0-21swapper/200:35:002
172923499108,1cyclictest1026-21snmpd22:37:152
172923499107,2cyclictest1026-21snmpd22:56:452
172923499107,2cyclictest1026-21snmpd22:26:422
172923499100,9cyclictest0-21swapper/219:32:572
172923299109,1cyclictest718063-21llvmpipe-022:25:591
172923299109,1cyclictest1018-21nmbd23:40:241
172923299108,1cyclictest1026-21snmpd00:23:541
172923299105,4cyclictest0-21swapper/100:12:421
172923299100,10cyclictest0-21swapper/123:52:561
172923299100,10cyclictest0-21swapper/123:52:561
172923299100,10cyclictest0-21swapper/120:30:141
172922999109,1cyclictest1026-21snmpd23:36:350
172922999109,1cyclictest1026-21snmpd00:03:080
172922999109,1cyclictest0-21swapper/023:43:350
172922999108,2cyclictest1026-21snmpd19:53:000
172922999108,1cyclictest1026-21snmpd23:57:130
172922999108,1cyclictest1026-21snmpd23:52:110
172922999108,1cyclictest1026-21snmpd23:52:110
172922999108,1cyclictest1026-21snmpd23:10:220
172922999108,1cyclictest1026-21snmpd00:16:060
172922999100,10cyclictest0-21swapper/022:10:020
172922999100,10cyclictest0-21swapper/020:14:140
17292399997,1cyclictest1026-21snmpd22:41:393
17292399990,9cyclictest0-21swapper/300:31:423
17292399990,8cyclictest1830022-21wc23:20:163
17292299998,1cyclictest1026-21snmpd20:00:290
17292299990,9cyclictest0-21swapper/022:40:130
17292299990,9cyclictest0-21swapper/022:35:390
17292299990,9cyclictest0-21swapper/022:20:320
17292349985,2cyclictest1026-21snmpd00:25:002
17292329986,1cyclictest1843635-21fschecks_count23:55:131
17292329985,2cyclictest1026-21snmpd00:01:411
17292399973,3cyclictest1782429-21cat21:20:153
17292329975,1cyclictest1026-21snmpd22:55:541
17292299970,7cyclictest0-21swapper/021:20:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional