You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-06-17 - 18:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot7s.osadl.org (updated Mon Jun 17, 2024 00:43:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1251567212372,42sleep20-21swapper/219:06:322
1251580212171,20sleep00-21swapper/019:06:430
1251735211972,20sleep10-21swapper/119:08:401
1251793211687,21sleep30-21swapper/319:09:263
125201299689,39cyclictest0-21swapper/222:24:322
125200699240,15cyclictest0-21swapper/023:00:050
143599220,3ntpd1281583-21ntpq20:20:281
125201299220,13cyclictest0-21swapper/200:33:342
125200699195,13cyclictest0-21swapper/021:00:010
1252006991918,1cyclictest1308195-21kworker/0:3+kacpid21:58:110
125200699190,4cyclictest0-21swapper/022:41:490
125201299188,9cyclictest0-21swapper/222:13:572
125201299188,9cyclictest0-21swapper/221:32:042
125201299180,4cyclictest0-21swapper/223:43:172
125201299180,18cyclictest0-21swapper/200:21:482
125201299180,17cyclictest1277009-21df_inode20:10:102
125200699180,3cyclictest0-21swapper/021:46:110
125200699180,3cyclictest0-21swapper/021:27:020
217799170,2rtkit-daemon2176-21rtkit-daemon21:26:093
125201599170,16cyclictest0-21swapper/322:55:553
125201599170,16cyclictest0-21swapper/322:53:193
125201599170,16cyclictest0-21swapper/300:35:173
125201299172,6cyclictest0-21swapper/222:51:132
125201299170,1cyclictest0-21swapper/220:48:402
125201099170,8cyclictest1299546-21ntpq21:05:221
125201099170,3cyclictest0-21swapper/119:10:221
125201099170,1cyclictest0-21swapper/119:33:121
125200699177,10cyclictest0-21swapper/023:34:020
1252006991712,4cyclictest0-21swapper/022:46:160
125200699170,2cyclictest0-21swapper/000:38:010
125200699170,16cyclictest0-21swapper/021:23:050
143599160,3ntpd0-21swapper/221:35:152
125201599161,6cyclictest0-21swapper/320:33:073
125201599160,15cyclictest0-21swapper/323:55:163
125201299166,9cyclictest0-21swapper/221:48:502
125201299166,10cyclictest0-21swapper/223:38:512
1252012991614,1cyclictest1032-21nmbd23:33:382
1252010991614,1cyclictest1038-21snmpd23:51:541
1252010991614,1cyclictest1038-21snmpd19:37:101
125201099160,8cyclictest0-21swapper/123:55:091
125201099160,7cyclictest0-21swapper/122:19:061
125201099160,7cyclictest0-21swapper/121:12:041
125201099160,7cyclictest0-21swapper/120:40:451
125201099160,1cyclictest0-21swapper/119:22:451
125201099160,15cyclictest0-21swapper/122:20:061
125201099160,15cyclictest0-21swapper/122:05:401
125201099160,15cyclictest0-21swapper/121:24:201
125200699168,0cyclictest0-21swapper/000:01:130
125200699167,9cyclictest0-21swapper/019:57:560
1252006991611,4cyclictest0-21swapper/022:01:510
125200699160,16cyclictest0-21swapper/023:18:130
125200699160,16cyclictest0-21swapper/022:32:010
125200699160,16cyclictest0-21swapper/020:42:360
125200699160,16cyclictest0-21swapper/000:09:130
125200699160,15cyclictest0-21swapper/022:08:240
217799150,2rtkit-daemon1038-21snmpd23:46:513
143599150,8ntpd0-21swapper/123:40:201
1252015991513,1cyclictest1038-21snmpd21:02:193
125201599150,6cyclictest0-21swapper/322:05:123
125201599150,6cyclictest0-21swapper/319:48:463
125201599150,15cyclictest0-21swapper/322:35:193
125201299159,5cyclictest1252176-21sort19:10:132
125201299156,9cyclictest0-21swapper/222:58:412
125201299156,9cyclictest0-21swapper/200:02:072
125201299155,9cyclictest0-21swapper/221:42:042
1252012991510,5cyclictest0-21swapper/221:07:342
125201299150,7cyclictest0-21swapper/200:35:072
125201299150,6cyclictest0-21swapper/220:32:552
125201299150,15cyclictest0-21swapper/222:38:162
1252010991514,1cyclictest1038-21snmpd21:34:501
125201099150,7cyclictest0-21swapper/119:41:111
125201099150,6cyclictest0-21swapper/123:38:061
125201099150,6cyclictest0-21swapper/122:45:401
125201099150,6cyclictest0-21swapper/122:01:121
125201099150,6cyclictest0-21swapper/121:58:391
125201099150,6cyclictest0-21swapper/120:11:381
125201099150,15cyclictest0-21swapper/123:13:441
125201099150,15cyclictest0-21swapper/100:09:581
125201099150,15cyclictest0-21swapper/100:00:221
125200699155,9cyclictest0-21swapper/023:45:060
1252006991513,1cyclictest1038-21snmpd23:52:240
125200699150,15cyclictest0-21swapper/023:58:150
125200699150,15cyclictest0-21swapper/023:37:270
125200699150,15cyclictest0-21swapper/020:25:530
217799140,1rtkit-daemon133728-21gmain00:31:423
217799140,0rtkit-daemon0-21swapper/323:40:593
125201599140,6cyclictest0-21swapper/300:19:253
125201299145,9cyclictest0-21swapper/223:12:502
125201299145,9cyclictest0-21swapper/219:30:272
1252012991412,2cyclictest1038-21snmpd22:48:372
125201299140,6cyclictest0-21swapper/219:44:172
1252010991412,1cyclictest1038-21snmpd20:54:221
125201099140,6cyclictest0-21swapper/123:08:351
125201099140,6cyclictest0-21swapper/121:53:511
125200699149,4cyclictest0-21swapper/021:13:250
1252006991410,4cyclictest0-21swapper/023:11:170
125200699140,6cyclictest0-21swapper/020:50:060
125200699140,5cyclictest0-21swapper/022:14:150
125200699140,14cyclictest0-21swapper/021:05:210
217799130,1rtkit-daemon1038-21snmpd19:53:571
217799130,0rtkit-daemon0-21swapper/122:38:451
143599130,5ntpd0-21swapper/323:25:183
125201599138,5cyclictest0-21swapper/322:24:163
1252015991312,1cyclictest0-21swapper/321:18:553
1252015991311,1cyclictest1038-21snmpd23:23:023
1252015991310,2cyclictest1038-21snmpd19:43:103
125201299134,9cyclictest0-21swapper/223:58:012
125201299133,9cyclictest1258095-21users19:20:242
1252012991312,1cyclictest0-21swapper/220:40:302
1252012991311,1cyclictest1038-21snmpd20:04:472
1252012991310,2cyclictest1038-21snmpd20:27:142
1252010991311,1cyclictest1038-21snmpd20:36:181
125201099130,5cyclictest0-21swapper/121:36:591
125201099130,5cyclictest0-21swapper/119:59:531
125200699139,1cyclictest0-21swapper/019:27:250
125200699135,8cyclictest0-21swapper/000:20:450
1252006991312,1cyclictest0-21swapper/019:20:170
1252006991310,2cyclictest1038-21snmpd19:48:430
125200699130,13cyclictest0-21swapper/020:10:180
125200699130,13cyclictest0-21swapper/019:10:330
125200699130,12cyclictest0-21swapper/019:30:130
217799120,1rtkit-daemon2176-21rtkit-daemon21:13:323
125201599129,2cyclictest1279632-21pmu-power20:15:233
125201599129,2cyclictest1038-21snmpd23:36:543
125201599129,2cyclictest1038-21snmpd19:10:433
125201599128,4cyclictest0-21swapper/300:05:153
125201599123,9cyclictest0-21swapper/321:55:573
1252015991211,1cyclictest0-21swapper/323:00:553
1252015991210,1cyclictest1038-21snmpd20:56:103
1252015991210,1cyclictest0-21swapper/323:05:153
125201299129,2cyclictest1038-21snmpd23:00:042
125201299123,9cyclictest0-21swapper/222:26:012
125201299123,9cyclictest0-21swapper/200:28:532
1252012991211,1cyclictest1-21systemd00:14:592
125201299120,4cyclictest0-21swapper/221:01:522
125201299120,12cyclictest0-21swapper/222:05:002
1252010991210,2cyclictest1038-21snmpd23:25:291
125201099120,11cyclictest0-21swapper/122:10:301
125201099120,11cyclictest0-21swapper/121:26:201
125201099120,11cyclictest0-21swapper/120:05:511
125200699129,2cyclictest1038-21snmpd21:43:350
125200699123,8cyclictest0-21swapper/021:32:050
1252006991211,1cyclictest1038-21snmpd19:52:130
1252006991211,1cyclictest0-21swapper/000:13:420
1252006991210,1cyclictest1038-21snmpd20:32:270
125200699120,12cyclictest0-21swapper/023:25:260
125200699120,12cyclictest0-21swapper/020:20:290
125201599119,1cyclictest1038-21snmpd23:11:113
125201599119,1cyclictest1038-21snmpd22:10:453
125201599119,1cyclictest1038-21snmpd21:38:383
125201599119,1cyclictest1038-21snmpd20:50:033
125201599119,1cyclictest1038-21snmpd00:02:433
125201599118,2cyclictest1038-21snmpd23:34:513
125201599118,2cyclictest1038-21snmpd23:15:173
125201599118,2cyclictest1038-21snmpd22:45:543
125201599118,2cyclictest1038-21snmpd22:44:553
125201599118,2cyclictest1038-21snmpd00:14:463
125201599117,4cyclictest0-21swapper/322:31:073
125201599117,4cyclictest0-21swapper/319:36:143
125201599117,1cyclictest0-21swapper/320:28:483
125201599116,4cyclictest0-21swapper/321:50:113
125201599116,4cyclictest0-21swapper/321:05:163
1252015991110,1cyclictest1038-21snmpd22:25:583
1252015991110,1cyclictest1038-21snmpd20:04:293
1252015991110,1cyclictest0-21swapper/319:15:193
125201599110,10cyclictest1367931-21sd-close00:30:003
125201599110,10cyclictest0-21swapper/300:22:543
125201299119,1cyclictest1038-21snmpd23:22:082
125201299119,1cyclictest1038-21snmpd23:15:382
125201299119,1cyclictest1038-21snmpd22:41:342
125201299119,1cyclictest1038-21snmpd21:55:512
125201299119,1cyclictest1038-21snmpd21:22:532
125201299119,1cyclictest1038-21snmpd20:51:512
125201299119,1cyclictest1038-21snmpd20:19:592
125201299118,2cyclictest1315521-21unixbench_multi22:15:292
125201299118,2cyclictest1032-21nmbd20:05:092
125201299117,3cyclictest1363108-21pmu-power00:15:242
125201299112,9cyclictest0-21swapper/222:31:042
125201099119,1cyclictest1038-21snmpd23:01:171
125201099119,1cyclictest1038-21snmpd21:01:021
1252010991110,1cyclictest0-21swapper/120:25:191
125201099110,1cyclictest0-21swapper/123:30:091
125201099110,1cyclictest0-21swapper/121:16:071
125201099110,1cyclictest0-21swapper/119:15:481
125201099110,11cyclictest0-21swapper/122:44:161
125201099110,10cyclictest1349925-21dump-pmu-power23:49:541
125201099110,10cyclictest0-21swapper/122:26:041
125201099110,10cyclictest0-21swapper/121:42:351
125201099110,10cyclictest0-21swapper/120:45:061
125200699119,1cyclictest1038-21snmpd20:45:330
125200699119,1cyclictest1038-21snmpd20:01:320
125200699118,2cyclictest1038-21snmpd23:44:170
125200699118,2cyclictest1038-21snmpd22:25:130
125200699118,2cyclictest1038-21snmpd19:35:070
125200699116,4cyclictest0-21swapper/022:35:030
125200699111,5cyclictest1362943-21sort00:15:190
125200699110,5cyclictest0-21swapper/021:18:070
125200699110,11cyclictest0-21swapper/019:40:250
125201599108,1cyclictest1038-21snmpd20:06:453
125201599108,1cyclictest1038-21snmpd19:50:533
125201599107,2cyclictest1038-21snmpd22:04:153
125201599107,2cyclictest1038-21snmpd21:33:413
125201599107,2cyclictest1038-21snmpd21:23:083
125201599105,4cyclictest0-21swapper/319:30:093
125201599104,5cyclictest0-21swapper/321:46:143
125201599100,9cyclictest0-21swapper/323:50:053
125201599100,9cyclictest0-21swapper/319:25:153
125201599100,10cyclictest0-21swapper/322:18:123
125201599100,10cyclictest0-21swapper/320:46:153
125201599100,10cyclictest0-21swapper/320:22:173
125201299109,1cyclictest1038-21snmpd19:18:572
125201299109,1cyclictest0-21swapper/219:45:232
125201299108,1cyclictest1038-21snmpd21:10:402
125201299108,1cyclictest1038-21snmpd20:38:422
125201299106,4cyclictest0-21swapper/223:53:272
125201299106,1cyclictest0-21swapper/219:36:072
1252012991010,0cyclictest0-21swapper/223:49:152
125201299100,9cyclictest0-21swapper/222:06:572
125201299100,10cyclictest0-21swapper/223:27:202
125201299100,10cyclictest0-21swapper/221:16:132
125201299100,10cyclictest0-21swapper/200:05:272
125201099109,1cyclictest1038-21snmpd19:48:461
125201099109,1cyclictest1038-21snmpd00:29:261
125201099109,1cyclictest0-21swapper/121:45:181
125201099107,2cyclictest1450-21crond19:59:591
125201099107,2cyclictest1038-21snmpd22:53:431
125201099100,4cyclictest0-21swapper/120:30:541
125201099100,10cyclictest0-21swapper/100:36:011
125201099100,10cyclictest0-21swapper/100:30:351
125200699109,1cyclictest1038-21snmpd22:21:450
125200699109,1cyclictest1038-21snmpd00:31:590
125200699108,1cyclictest1038-21snmpd22:51:570
125200699108,1cyclictest1038-21snmpd22:18:300
125200699106,4cyclictest0-21swapper/023:24:080
125200699106,4cyclictest0-21swapper/019:18:580
125200699100,10cyclictest0-21swapper/021:52:050
125200699100,10cyclictest0-21swapper/020:16:200
14359990,2ntpd1279112-21fschecks_time20:15:142
14359990,1ntpd0-21swapper/319:55:213
14359990,1ntpd0-21swapper/119:25:211
14359990,1ntpd0-21swapper/100:15:221
14359990,1ntpd0-21swapper/021:35:140
12520159990,9cyclictest0-21swapper/321:43:023
12520159990,9cyclictest0-21swapper/320:40:333
12520159990,9cyclictest0-21swapper/320:35:483
12520159990,9cyclictest0-21swapper/319:22:033
12520129998,1cyclictest1038-21snmpd21:29:262
12520129997,1cyclictest1038-21snmpd23:07:232
12520129997,1cyclictest1038-21snmpd19:50:192
12520129995,4cyclictest0-21swapper/221:50:262
12520129990,9cyclictest0-21swapper/220:58:042
12520129990,9cyclictest0-21swapper/219:56:522
12520129990,9cyclictest0-21swapper/219:26:192
12520109998,1cyclictest1038-21snmpd22:57:041
12520109998,1cyclictest1038-21snmpd00:11:071
12520109990,9cyclictest0-21swapper/123:20:381
12520109990,9cyclictest0-21swapper/120:59:181
12520109990,9cyclictest0-21swapper/120:18:381
12520069996,2cyclictest1038-21snmpd22:55:190
12520069996,2cyclictest1038-21snmpd20:58:490
12520069995,4cyclictest0-21swapper/023:05:160
12520069995,4cyclictest0-21swapper/020:07:380
12520069990,9cyclictest0-21swapper/020:38:270
14359980,1ntpd1367020-21ntpq00:25:190
14359980,0ntpd0-21swapper/123:15:151
12520159985,2cyclictest1038-21snmpd20:10:473
12520109976,1cyclictest1038-21snmpd22:31:221
12520109976,1cyclictest1038-21snmpd00:22:541
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional