You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-02 - 12:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack0slot7s.osadl.org (updated Fri May 02, 2025 00:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3607623212671,22sleep20-21swapper/219:07:042
3607683212572,23sleep00-21swapper/019:07:500
3607777210659,12sleep10-21swapper/119:09:031
3607516210273,21sleep30-21swapper/319:05:403
360801999868,40cyclictest0-21swapper/122:10:231
3608025992712,14cyclictest0-21swapper/300:10:133
3608023992612,13cyclictest0-21swapper/200:10:122
3608019992513,12cyclictest0-21swapper/100:10:161
360801999250,25cyclictest0-21swapper/123:54:421
360802599240,15cyclictest0-21swapper/320:31:053
360801999240,16cyclictest0-21swapper/123:19:181
360802599230,15cyclictest0-21swapper/319:12:343
360801999220,13cyclictest0-21swapper/123:06:041
360801799220,21cyclictest0-21swapper/019:45:190
3608025992115,5cyclictest1051-21snmpd19:39:343
360801999205,7cyclictest3668586-21irqstats21:40:161
360802599199,4cyclictest0-21swapper/320:46:423
360802599180,17cyclictest0-21swapper/322:16:533
360801799185,13cyclictest0-21swapper/023:18:090
360801799180,17cyclictest0-21swapper/023:58:120
360801799180,17cyclictest0-21swapper/019:26:240
360801799180,17cyclictest0-21swapper/000:04:180
3608025991716,1cyclictest0-21swapper/321:21:533
3608025991715,1cyclictest0-21swapper/321:10:393
360802599170,17cyclictest0-21swapper/323:37:053
360802599170,16cyclictest0-21swapper/319:49:563
360802599170,15cyclictest0-21swapper/321:01:193
3608023991716,1cyclictest0-21swapper/200:39:592
360801999174,13cyclictest0-21swapper/123:34:051
360801999170,17cyclictest0-21swapper/100:23:251
360801799176,5cyclictest0-21swapper/020:05:290
3608017991715,1cyclictest1051-21snmpd22:26:220
3608017991715,1cyclictest0-21swapper/019:39:290
3608017991711,5cyclictest0-21swapper/022:49:430
360801799170,16cyclictest0-21swapper/021:52:320
360801799170,16cyclictest0-21swapper/020:20:170
360801799170,16cyclictest0-21swapper/020:12:330
360801799170,16cyclictest0-21swapper/000:08:150
360802599166,10cyclictest0-21swapper/321:44:283
3608025991614,1cyclictest1051-21snmpd19:51:283
3608025991612,4cyclictest0-21swapper/322:49:203
360802599160,7cyclictest0-21swapper/323:10:153
360802599160,7cyclictest0-21swapper/323:00:593
360802599160,15cyclictest0-21swapper/320:20:203
3608023991614,1cyclictest1051-21snmpd20:14:452
3608019991614,1cyclictest1051-21snmpd00:37:311
3608019991612,4cyclictest0-21swapper/121:17:581
360801999160,7cyclictest0-21swapper/121:31:111
360801999160,16cyclictest0-21swapper/119:51:231
3608017991615,1cyclictest0-21swapper/022:32:330
360801799160,7cyclictest0-21swapper/019:10:580
360801799160,16cyclictest0-21swapper/019:42:370
360801799160,16cyclictest0-21swapper/019:15:340
360801799160,15cyclictest0-21swapper/022:50:170
360801799160,15cyclictest0-21swapper/020:34:330
360802599159,5cyclictest1051-21snmpd22:50:403
360802599159,5cyclictest1051-21snmpd19:29:073
360802599155,4cyclictest0-21swapper/320:13:333
3608025991511,4cyclictest0-21swapper/322:11:363
3608025991511,4cyclictest0-21swapper/321:54:443
3608025991511,3cyclictest0-21swapper/323:05:013
3608025991511,1cyclictest0-21swapper/319:32:043
3608025991510,5cyclictest3608012-21cyclictest00:29:593
3608025991510,4cyclictest1051-21snmpd00:34:373
360802599150,6cyclictest0-21swapper/321:30:293
360802599150,1cyclictest0-21swapper/323:20:183
360802599150,15cyclictest0-21swapper/323:41:303
360802599150,15cyclictest0-21swapper/323:33:203
360802599150,15cyclictest0-21swapper/322:30:573
360802599150,15cyclictest0-21swapper/319:17:103
360802399150,7cyclictest0-21swapper/219:11:452
360802399150,6cyclictest0-21swapper/220:09:312
360802399150,15cyclictest0-21swapper/223:44:252
360802399150,15cyclictest0-21swapper/223:04:442
360802399150,15cyclictest0-21swapper/222:55:172
360801999156,9cyclictest0-21swapper/121:01:231
3608019991511,4cyclictest0-21swapper/122:38:131
3608019991511,4cyclictest0-21swapper/122:38:121
3608019991511,4cyclictest0-21swapper/121:26:341
360801999150,6cyclictest0-21swapper/120:55:581
360801999150,15cyclictest0-21swapper/122:41:331
360801999150,15cyclictest0-21swapper/119:22:521
3608017991513,1cyclictest1051-21snmpd23:37:350
3608017991513,1cyclictest0-21swapper/000:15:150
3608017991513,1cyclictest0-21swapper/000:10:150
3608017991511,4cyclictest0-21swapper/023:51:240
360801799150,7cyclictest0-21swapper/022:18:180
360801799150,6cyclictest0-21swapper/000:36:160
360802599149,4cyclictest1051-21snmpd20:57:273
360802599144,10cyclictest0-21swapper/322:58:103
360802599143,10cyclictest0-21swapper/321:05:043
360802599141,4cyclictest0-21swapper/321:58:273
360802599141,4cyclictest0-21swapper/319:40:053
3608025991412,1cyclictest0-21swapper/323:50:233
3608025991411,2cyclictest1051-21snmpd22:38:223
3608025991411,2cyclictest1051-21snmpd22:38:213
360802399146,8cyclictest0-21swapper/221:30:382
3608023991412,1cyclictest1051-21snmpd00:04:482
3608019991410,4cyclictest0-21swapper/122:57:251
360801999140,1cyclictest0-21swapper/120:45:221
360801999140,13cyclictest0-21swapper/120:10:001
3608017991412,1cyclictest0-21swapper/022:38:490
3608017991412,1cyclictest0-21swapper/022:38:480
3608017991410,1cyclictest0-21swapper/022:41:270
360801799140,13cyclictest0-21swapper/022:20:210
360801799140,13cyclictest0-21swapper/022:07:380
360801799140,13cyclictest0-21swapper/021:30:210
360801799140,13cyclictest0-21swapper/020:45:210
360802599137,5cyclictest1051-21snmpd19:23:493
360802599132,10cyclictest0-21swapper/322:26:403
3608025991312,1cyclictest0-21swapper/322:05:213
3608025991311,1cyclictest0-21swapper/300:00:483
3608025991310,2cyclictest1051-21snmpd00:35:373
3608025991310,2cyclictest0-21swapper/321:45:083
360802399139,1cyclictest0-21swapper/200:06:212
360802399134,9cyclictest0-21swapper/220:34:532
360802399133,10cyclictest0-21swapper/223:36:502
3608023991312,1cyclictest1051-21snmpd20:44:522
3608023991311,1cyclictest1051-21snmpd19:25:102
360802399130,1cyclictest0-21swapper/223:30:222
360802399130,13cyclictest0-21swapper/219:50:182
360801999139,4cyclictest0-21swapper/119:44:201
3608019991312,1cyclictest1051-21snmpd23:03:131
3608019991310,2cyclictest798-21systemd-machine20:09:581
360801799139,1cyclictest0-21swapper/021:44:040
3608017991312,1cyclictest0-21swapper/019:30:150
360801799130,13cyclictest0-21swapper/022:55:170
360801799130,13cyclictest0-21swapper/000:30:210
360801799130,13cyclictest0-21swapper/000:20:190
360801799130,12cyclictest0-21swapper/021:15:160
360802599129,2cyclictest3635337-21pmu-power20:15:213
360802599129,2cyclictest1051-21snmpd23:46:003
360802599129,2cyclictest1051-21snmpd20:26:123
360802599129,2cyclictest1051-21snmpd00:18:253
360802599126,5cyclictest1051-21snmpd00:24:473
360802599121,4cyclictest0-21swapper/321:19:053
3608025991211,1cyclictest0-21swapper/320:08:113
360802399123,9cyclictest0-21swapper/222:04:242
360802399123,9cyclictest0-21swapper/200:30:152
360802399122,10cyclictest0-21swapper/223:21:292
3608023991211,1cyclictest1051-21snmpd23:50:392
3608023991211,1cyclictest0-21swapper/222:10:172
3608023991210,1cyclictest1051-21snmpd22:46:212
360802399120,12cyclictest0-21swapper/221:14:362
360801999129,2cyclictest1051-21snmpd22:50:081
360801999123,9cyclictest0-21swapper/122:33:371
3608019991210,1cyclictest1051-21snmpd20:17:571
360801799129,2cyclictest1051-21snmpd23:47:030
360801799129,2cyclictest1051-21snmpd23:41:590
360801799129,2cyclictest1051-21snmpd21:55:200
360801799129,2cyclictest1051-21snmpd21:27:250
360801799129,2cyclictest1051-21snmpd21:11:550
360801799122,4cyclictest0-21swapper/019:56:460
3608017991210,1cyclictest1051-21snmpd23:10:100
3608017991210,1cyclictest1051-21snmpd20:50:100
360801799120,1cyclictest0-21swapper/022:10:150
360801799120,1cyclictest0-21swapper/000:25:210
360801799120,12cyclictest0-21swapper/021:45:220
360801799120,12cyclictest0-21swapper/021:35:200
360802599118,2cyclictest3721883-21awk23:55:143
360802599116,4cyclictest1051-21snmpd23:25:213
360802599116,4cyclictest0-21swapper/300:05:213
360802599112,9cyclictest0-21swapper/320:00:173
360802599111,4cyclictest3628232-21sleep19:59:593
360802599111,10cyclictest0-21swapper/321:38:523
360802599110,9cyclictest0-21swapper/320:50:253
360802599110,3cyclictest0-21swapper/320:37:033
360802599110,10cyclictest0-21swapper/322:02:213
360802399119,2cyclictest987-21gdbus23:19:592
360802399119,2cyclictest876-21NetworkManager21:05:222
360802399119,2cyclictest1051-21snmpd21:03:482
360802399119,1cyclictest1051-21snmpd21:51:442
360802399116,5cyclictest0-21swapper/222:40:572
360802399111,10cyclictest0-21swapper/222:15:472
3608023991110,1cyclictest1051-21snmpd21:22:022
3608023991110,1cyclictest1051-21snmpd19:58:142
3608023991110,1cyclictest0-21swapper/220:39:272
360802399110,1cyclictest0-21swapper/223:25:562
360802399110,11cyclictest0-21swapper/222:25:252
360802399110,11cyclictest0-21swapper/220:25:482
360802399110,10cyclictest0-21swapper/222:20:092
360802399110,10cyclictest0-21swapper/220:50:162
360801999119,2cyclictest1051-21snmpd00:07:241
360801999119,1cyclictest1051-21snmpd23:37:051
360801999119,1cyclictest1051-21snmpd22:29:341
360801999119,1cyclictest1045-21nmbd00:16:481
360801999118,2cyclictest1051-21snmpd22:45:241
360801999118,2cyclictest1045-21nmbd20:50:281
360801999118,2cyclictest0-21swapper/122:20:221
360801999116,1cyclictest0-21swapper/119:45:201
360801999114,7cyclictest0-21swapper/122:15:181
360801999112,9cyclictest0-21swapper/123:42:511
360801999112,9cyclictest0-21swapper/120:38:541
360801999112,9cyclictest0-21swapper/120:22:071
3608019991110,1cyclictest3723861-21awk00:00:141
3608019991110,1cyclictest3721860-21awk23:55:151
3608019991110,1cyclictest1051-21snmpd20:31:511
360801999110,11cyclictest0-21swapper/121:35:151
360801799119,1cyclictest1051-21snmpd20:55:310
360801799119,1cyclictest1051-21snmpd20:16:180
360801799118,2cyclictest1051-21snmpd23:20:440
360801799118,2cyclictest1051-21snmpd23:06:160
360801799118,2cyclictest1051-21snmpd22:00:360
360801799118,2cyclictest1051-21snmpd20:40:150
360801799117,4cyclictest0-21swapper/020:29:180
3608017991110,1cyclictest0-21swapper/019:50:220
360801799110,1cyclictest0-21swapper/021:00:200
360801799110,10cyclictest0-21swapper/019:22:400
360802599107,2cyclictest3662384-21fschecks_count21:25:163
360802599107,2cyclictest1051-21snmpd23:15:353
360802599103,2cyclictest3644689-21fschecks_time20:40:203
360802599102,3cyclictest3683792-21grep22:20:123
360802399109,1cyclictest1051-21snmpd22:31:122
360802399108,1cyclictest1051-21snmpd00:24:132
360802399107,2cyclictest3619917-21unixbench_singl19:35:212
360802399107,2cyclictest3618360-21crond19:34:592
360802399107,2cyclictest1051-21snmpd20:45:092
360802399106,4cyclictest0-21swapper/223:11:582
360802399106,1cyclictest0-21swapper/221:36:372
360802399106,1cyclictest0-21swapper/220:03:382
360802399104,5cyclictest0-21swapper/219:15:142
360802399100,10cyclictest0-21swapper/223:56:252
360802399100,10cyclictest0-21swapper/222:35:432
360802399100,10cyclictest0-21swapper/222:35:422
360802399100,10cyclictest0-21swapper/222:09:022
360802399100,10cyclictest0-21swapper/221:55:292
360802399100,10cyclictest0-21swapper/221:48:202
360802399100,10cyclictest0-21swapper/221:40:552
360802399100,10cyclictest0-21swapper/221:26:132
360802399100,10cyclictest0-21swapper/220:56:192
360802399100,10cyclictest0-21swapper/219:41:382
360802399100,10cyclictest0-21swapper/200:26:012
360802399100,10cyclictest0-21swapper/200:15:402
360801999109,1cyclictest1051-21snmpd21:12:181
360801999109,1cyclictest1051-21snmpd19:32:041
360801999109,1cyclictest1051-21snmpd19:17:041
360801999106,3cyclictest3619031-21tune2fs19:35:131
360801999100,4cyclictest0-21swapper/120:29:451
360801999100,1cyclictest0-21swapper/121:50:111
360801999100,10cyclictest0-21swapper/123:48:241
360801999100,10cyclictest0-21swapper/123:25:351
360801999100,10cyclictest0-21swapper/123:11:371
360801999100,10cyclictest0-21swapper/122:06:171
360801999100,10cyclictest0-21swapper/121:48:381
360801999100,10cyclictest0-21swapper/121:07:161
360801999100,10cyclictest0-21swapper/119:25:481
360801999100,10cyclictest0-21swapper/119:12:131
360801999100,10cyclictest0-21swapper/100:32:251
360801799108,2cyclictest3661389-21sed21:20:270
360801799108,2cyclictest1550-21ntpd23:01:230
360801799107,2cyclictest1051-21snmpd23:25:560
360801799100,10cyclictest0-21swapper/020:35:560
36080259990,4cyclictest3692966-21tail22:40:213
36080239998,1cyclictest3623135-21awk19:45:192
36080239996,2cyclictest1051-21snmpd22:52:072
36080239990,9cyclictest0-21swapper/223:47:242
36080239990,9cyclictest0-21swapper/220:21:452
36080239990,8cyclictest3613293-21irqstats19:20:152
36080239990,3cyclictest3634900-21fschecks_time20:15:172
36080199998,1cyclictest1051-21snmpd23:21:351
36080199998,1cyclictest1051-21snmpd20:00:171
36080199998,1cyclictest1051-21snmpd00:28:221
36080199996,2cyclictest1051-21snmpd21:56:231
36080199995,4cyclictest0-21swapper/121:21:441
36080179996,2cyclictest1051-21snmpd23:32:240
36080179996,2cyclictest1051-21snmpd20:02:350
36080239980,8cyclictest3702045-21fschecks_time23:05:142
36080239980,7cyclictest3658947-21ntpq21:15:172
36080199987,1cyclictest3676831-21ps22:00:201
36080199986,1cyclictest1051-21snmpd19:56:441
36080179980,8cyclictest0-21swapper/021:05:200
36080199970,2cyclictest0-21swapper/120:40:231
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional