You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-03-21 - 08:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack0slot7s.osadl.org (updated Fri Mar 21, 2025 00:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1700806212771,23sleep20-21swapper/219:07:332
1700822212071,21sleep30-21swapper/319:07:463
1700983211868,21sleep00-21swapper/019:09:460
1700136211566,38sleep10-21swapper/119:05:191
1701167993711,2cyclictest0-21swapper/121:40:061
170117099330,17cyclictest1794613-21df23:35:132
170117099320,16cyclictest0-21swapper/200:04:552
170117099290,16cyclictest0-21swapper/200:15:012
170117099290,16cyclictest0-21swapper/200:15:012
170116499280,19cyclictest0-21swapper/021:15:170
170117099270,16cyclictest0-21swapper/223:45:282
170117099260,10cyclictest0-21swapper/223:44:262
1701164992612,13cyclictest0-21swapper/022:30:120
170116499260,25cyclictest0-21swapper/023:31:190
170117099250,9cyclictest0-21swapper/223:30:072
170117099250,9cyclictest0-21swapper/200:20:082
170117099250,9cyclictest0-21swapper/200:13:592
170116799250,24cyclictest0-21swapper/119:44:241
170117099240,8cyclictest0-21swapper/200:34:282
170117099240,8cyclictest0-21swapper/200:25:152
1701173992313,4cyclictest0-21swapper/319:32:413
170117099230,7cyclictest0-21swapper/223:54:402
1701164992318,4cyclictest1051-21snmpd21:50:070
170116499230,15cyclictest0-21swapper/021:12:180
170116499220,17cyclictest0-21swapper/022:48:080
1701173992110,5cyclictest0-21swapper/320:12:273
170117099210,5cyclictest0-21swapper/223:55:422
170117099210,5cyclictest0-21swapper/200:35:302
170117099210,5cyclictest0-21swapper/200:06:492
170116499219,4cyclictest0-21swapper/021:30:230
170117399201,4cyclictest0-21swapper/321:11:443
1701173992011,9cyclictest0-21swapper/300:14:393
1701170992012,8cyclictest0-21swapper/219:29:562
170117099200,4cyclictest1788781-21pmu-power23:15:182
1701164992017,3cyclictest0-21swapper/000:17:440
1701164992017,3cyclictest0-21swapper/000:17:440
1701164992010,7cyclictest0-21swapper/019:40:500
170116499200,3cyclictest0-21swapper/023:39:460
170117099198,5cyclictest0-21swapper/220:01:422
170116799190,15cyclictest0-21swapper/121:48:371
1701164991914,4cyclictest1051-21snmpd22:52:380
170117399188,10cyclictest0-21swapper/319:13:433
1701173991815,2cyclictest1051-21snmpd19:20:323
170117099187,5cyclictest0-21swapper/219:15:362
170117099184,14cyclictest0-21swapper/222:15:172
1701167991816,1cyclictest0-21swapper/122:16:411
170116499185,4cyclictest0-21swapper/022:25:500
1701164991816,1cyclictest0-21swapper/023:05:510
1701164991815,2cyclictest1045-21nmbd20:09:170
1701164991813,2cyclictest1051-21snmpd19:37:440
170117399178,9cyclictest0-21swapper/322:16:493
170117399175,12cyclictest0-21swapper/319:36:593
1701173991716,1cyclictest0-21swapper/322:04:393
1701173991714,2cyclictest1051-21snmpd00:29:513
170116799170,16cyclictest0-21swapper/122:56:381
170116799170,16cyclictest0-21swapper/121:34:001
170116799170,16cyclictest0-21swapper/100:26:081
170116799170,16cyclictest0-21swapper/100:18:501
170116799170,16cyclictest0-21swapper/100:18:501
170116499170,16cyclictest0-21swapper/022:09:580
1701173991613,2cyclictest1051-21snmpd19:40:133
1701173991611,5cyclictest0-21swapper/321:38:003
170117399160,8cyclictest0-21swapper/300:23:233
170117399160,7cyclictest0-21swapper/323:27:313
170117099167,9cyclictest0-21swapper/220:23:522
1701170991615,1cyclictest1051-21snmpd19:33:172
1701170991613,2cyclictest1051-21snmpd21:24:362
170117099160,16cyclictest0-21swapper/223:00:572
170117099160,16cyclictest0-21swapper/220:26:252
170117099160,15cyclictest1762506-21/usr/sbin/munin21:55:182
170116799165,11cyclictest0-21swapper/100:30:191
170116799165,10cyclictest0-21swapper/122:50:111
1701167991611,4cyclictest0-21swapper/123:26:431
170116799160,7cyclictest0-21swapper/100:23:051
170116799160,16cyclictest0-21swapper/120:10:271
170116499166,8cyclictest0-21swapper/023:27:520
170116499165,10cyclictest0-21swapper/023:45:550
170116499162,13cyclictest0-21swapper/023:41:220
170116499160,7cyclictest1719144-21ntpq19:55:180
170117399158,7cyclictest0-21swapper/321:06:393
170117399154,11cyclictest0-21swapper/322:35:163
170117399154,10cyclictest0-21swapper/300:06:053
170117399152,13cyclictest0-21swapper/323:39:523
1701173991514,1cyclictest0-21swapper/321:21:213
1701173991514,1cyclictest0-21swapper/319:18:173
1701173991510,4cyclictest0-21swapper/323:00:333
170117399150,7cyclictest0-21swapper/321:45:253
170117399150,7cyclictest0-21swapper/321:30:423
170117399150,6cyclictest0-21swapper/321:28:563
170117399150,6cyclictest0-21swapper/320:07:063
170117399150,15cyclictest0-21swapper/323:44:163
170117399150,15cyclictest0-21swapper/320:32:213
170117399150,15cyclictest0-21swapper/319:27:443
1701170991513,2cyclictest1051-21snmpd19:40:442
1701170991513,1cyclictest1051-21snmpd21:14:352
1701170991512,2cyclictest1051-21snmpd23:22:002
1701170991511,4cyclictest0-21swapper/221:51:272
170117099150,6cyclictest0-21swapper/223:05:042
170117099150,6cyclictest0-21swapper/222:11:142
170116799155,4cyclictest0-21swapper/123:21:011
170116799154,10cyclictest17761522sleep122:35:531
170116799150,7cyclictest0-21swapper/119:34:161
170116799150,1cyclictest0-21swapper/120:05:171
170116499155,4cyclictest0-21swapper/021:45:520
170116499154,10cyclictest0-21swapper/019:30:430
170116499154,10cyclictest0-21swapper/000:30:120
1701164991512,2cyclictest1051-21snmpd23:51:550
170116499150,1cyclictest0-21swapper/020:00:180
170116499150,15cyclictest0-21swapper/022:11:520
170116499150,13cyclictest1811821-21munin-run00:29:590
170117399143,10cyclictest0-21swapper/300:15:023
170117399143,10cyclictest0-21swapper/300:15:023
170117399142,11cyclictest0-21swapper/320:00:003
1701173991412,1cyclictest1701159-21cyclictest22:45:023
170117399141,13cyclictest0-21swapper/322:53:303
1701173991410,1cyclictest0-21swapper/322:40:113
170117399140,13cyclictest0-21swapper/322:30:093
170117099143,1cyclictest0-21swapper/220:36:462
1701170991410,4cyclictest0-21swapper/219:13:222
170116799145,4cyclictest0-21swapper/122:05:491
170116799143,10cyclictest0-21swapper/120:36:581
170116799140,6cyclictest0-21swapper/121:51:061
170116799140,6cyclictest0-21swapper/119:56:211
170116799140,13cyclictest0-21swapper/120:40:191
170116799140,13cyclictest0-21swapper/120:25:111
170116499143,10cyclictest0-21swapper/021:05:330
1701164991411,2cyclictest873-21abrt-dump-journ00:38:090
1701164991411,2cyclictest1051-21snmpd23:01:300
1701164991411,2cyclictest1051-21snmpd19:22:020
1701164991411,2cyclictest1051-21snmpd19:11:190
170116499140,5cyclictest0-21swapper/000:12:070
170116499140,13cyclictest0-21swapper/022:24:470
170117399139,4cyclictest0-21swapper/321:01:473
170117399134,3cyclictest0-21swapper/323:06:313
170117399132,10cyclictest1717905-21sshd-session19:53:093
170117399132,10cyclictest1717905-21sshd-session19:53:083
170117399130,1cyclictest0-21swapper/300:35:163
170117399130,13cyclictest0-21swapper/320:25:123
170117099139,4cyclictest0-21swapper/221:02:192
170117099132,10cyclictest1713497-21munin-run19:39:592
1701170991310,2cyclictest1051-21snmpd22:28:562
170117099130,5cyclictest0-21swapper/220:11:182
170117099130,13cyclictest0-21swapper/221:25:562
170117099130,13cyclictest0-21swapper/219:55:212
170116799139,4cyclictest0-21swapper/123:16:151
170116799139,4cyclictest0-21swapper/119:16:161
170116799134,4cyclictest0-21swapper/100:38:031
1701167991312,1cyclictest0-21swapper/123:10:131
1701167991310,2cyclictest1792864-21fschecks_time23:30:091
1701167991310,2cyclictest1051-21snmpd23:06:341
1701167991310,2cyclictest1051-21snmpd21:28:051
1701167991310,2cyclictest1051-21snmpd19:29:381
170116799130,1cyclictest0-21swapper/123:50:091
170116799130,13cyclictest0-21swapper/120:48:551
170116499139,4cyclictest0-21swapper/021:28:440
170116499139,4cyclictest0-21swapper/019:52:120
170116499139,4cyclictest0-21swapper/019:52:120
170116499139,4cyclictest0-21swapper/000:22:530
170116499132,11cyclictest0-21swapper/022:18:050
170116499131,11cyclictest0-21swapper/022:56:060
1701164991310,2cyclictest1728500-21diskstats20:20:120
1701164991310,2cyclictest1051-21snmpd23:57:020
170116499130,1cyclictest0-21swapper/022:40:160
170116499130,1cyclictest0-21swapper/020:35:170
170116499130,13cyclictest0-21swapper/019:15:210
170116499130,12cyclictest0-21swapper/020:25:110
170117399129,2cyclictest1051-21snmpd21:43:123
170117399128,4cyclictest0-21swapper/322:21:583
170117399128,4cyclictest0-21swapper/320:35:403
170117399122,10cyclictest0-21swapper/320:59:163
1701173991210,1cyclictest1051-21snmpd22:27:533
1701173991210,1cyclictest1051-21snmpd22:08:163
170117399120,1cyclictest0-21swapper/323:20:123
170117399120,12cyclictest0-21swapper/320:40:163
170117099129,2cyclictest1051-21snmpd20:59:082
1701170991210,2cyclictest1051-21snmpd19:51:032
1701170991210,2cyclictest1051-21snmpd19:51:022
1701170991210,1cyclictest1051-21snmpd22:52:572
1701170991210,1cyclictest1051-21snmpd19:45:092
170117099120,12cyclictest0-21swapper/220:40:142
170117099120,12cyclictest0-21swapper/220:05:172
170116799129,2cyclictest873-21abrt-dump-journ21:09:581
170116799129,2cyclictest1762435-21needreboot21:55:171
170116799129,2cyclictest1051-21snmpd22:34:531
170116799129,2cyclictest1051-21snmpd00:11:231
170116799122,4cyclictest0-21swapper/119:46:421
1701167991211,1cyclictest0-21swapper/120:03:211
1701167991210,1cyclictest1051-21snmpd19:24:501
170116499129,2cyclictest873-21abrt-dump-journ20:40:100
170116499129,2cyclictest1051-21snmpd23:16:090
170116499129,2cyclictest1051-21snmpd22:37:470
1701164991211,1cyclictest0-21swapper/021:55:200
1701164991210,1cyclictest1051-21snmpd23:20:340
170116499120,12cyclictest0-21swapper/020:51:290
170116499120,11cyclictest0-21swapper/000:00:150
170117399119,1cyclictest1051-21snmpd23:51:193
170117399119,1cyclictest1051-21snmpd00:03:593
170117399118,2cyclictest1718879-21awk19:55:153
170117399118,2cyclictest1051-21snmpd23:10:183
170117399116,4cyclictest0-21swapper/321:50:003
1701173991110,1cyclictest0-21swapper/320:15:303
170117099119,1cyclictest1045-21nmbd19:22:482
170117099118,2cyclictest1051-21snmpd22:21:462
170117099113,8cyclictest0-21swapper/222:39:192
170117099112,9cyclictest0-21swapper/223:28:282
170117099111,10cyclictest0-21swapper/221:08:422
170117099110,11cyclictest0-21swapper/222:05:062
170116799119,1cyclictest1051-21snmpd22:48:231
170116799119,1cyclictest1051-21snmpd21:01:551
170116799119,1cyclictest1051-21snmpd20:21:121
170116799119,1cyclictest0-21swapper/123:40:141
170116799118,3cyclictest0-21swapper/120:54:281
170116799118,2cyclictest872-21abrt-dump-journ19:13:101
170116799118,2cyclictest1051-21snmpd23:35:191
170116799118,2cyclictest1051-21snmpd22:00:161
170116799110,4cyclictest0-21swapper/121:21:451
170116799110,1cyclictest0-21swapper/122:40:141
170116799110,10cyclictest0-21swapper/122:27:291
170116799110,10cyclictest0-21swapper/122:23:431
170116799110,10cyclictest0-21swapper/121:17:321
170116799110,10cyclictest0-21swapper/120:30:091
170116799110,10cyclictest0-21swapper/100:08:021
170116499119,2cyclictest1051-21snmpd20:49:580
170116499119,1cyclictest1051-21snmpd21:01:580
170116499119,1cyclictest0-21swapper/022:00:160
170116499117,1cyclictest0-21swapper/020:30:580
170116499110,10cyclictest0-21swapper/019:45:320
170117399109,1cyclictest1051-21snmpd21:15:363
170117399107,2cyclictest1051-21snmpd20:49:043
170117399106,4cyclictest0-21swapper/322:13:203
170117399106,1cyclictest0-21swapper/322:59:213
170117399100,9cyclictest0-21swapper/323:15:133
170117399100,10cyclictest0-21swapper/323:58:233
170117099109,1cyclictest1051-21snmpd21:46:012
170117099107,2cyclictest1727084-21ntpq20:15:162
170117099107,2cyclictest1051-21snmpd22:46:592
170117099107,2cyclictest1051-21snmpd21:38:062
170117099105,1cyclictest0-21swapper/220:51:022
170117099100,3cyclictest1757951-21ntpq21:40:172
170117099100,10cyclictest0-21swapper/223:10:062
170117099100,10cyclictest0-21swapper/222:58:262
170117099100,10cyclictest0-21swapper/222:42:272
170117099100,10cyclictest0-21swapper/221:18:482
170117099100,10cyclictest0-21swapper/220:30:162
170116799108,1cyclictest1051-21snmpd23:45:201
170116799107,2cyclictest1051-21snmpd20:15:101
170116799106,2cyclictest872-21abrt-dump-journ21:09:541
170116799100,9cyclictest0-21swapper/119:50:111
170116799100,9cyclictest0-21swapper/119:50:111
170116799100,9cyclictest0-21swapper/100:02:231
170116799100,10cyclictest0-21swapper/123:01:331
170116799100,10cyclictest0-21swapper/122:12:111
170116799100,10cyclictest0-21swapper/121:36:371
170116499108,1cyclictest1051-21snmpd21:22:480
170116499108,1cyclictest1051-21snmpd00:05:200
170116499107,2cyclictest1051-21snmpd20:11:030
170116499107,2cyclictest1051-21snmpd19:25:380
170116499100,1cyclictest0-21swapper/021:40:180
170116499100,10cyclictest0-21swapper/021:39:430
17011739997,1cyclictest1051-21snmpd23:46:163
17011739997,1cyclictest0-21swapper/323:35:003
17011739996,2cyclictest1812146-21cpuspeed_turbos00:30:113
17011739995,4cyclictest0-21swapper/319:46:213
17011739990,9cyclictest0-21swapper/321:58:383
17011739990,9cyclictest0-21swapper/320:50:293
17011709998,1cyclictest0-21swapper/222:00:172
17011709990,9cyclictest0-21swapper/221:32:572
17011709990,8cyclictest1773073-21df_inode22:30:082
17011709990,8cyclictest0-21swapper/220:45:132
17011679998,1cyclictest0-21swapper/123:56:251
17011679997,2cyclictest1712228-21fschecks_time19:35:161
17011679996,2cyclictest1051-21snmpd20:58:291
17011649996,2cyclictest1742116-21cpuspeed_turbos20:55:120
17011649980,1cyclictest0-21swapper/020:15:150
17011739970,7cyclictest0-21swapper/320:23:043
17011649973,3cyclictest1787090-21grep23:10:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional