You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-23 - 23:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot7s.osadl.org (updated Tue Apr 23, 2024 00:43:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
257253212472,21sleep30-21swapper/319:08:433
257007212369,21sleep20-21swapper/219:05:372
257305211971,21sleep10-21swapper/119:09:211
257330210073,20sleep00-21swapper/019:09:400
257501992814,13cyclictest0-21swapper/120:19:151
257506992612,14cyclictest0-21swapper/223:30:252
257511992512,12cyclictest0-21swapper/323:30:243
25750099250,24cyclictest0-21swapper/023:27:410
25750099228,13cyclictest0-21swapper/021:06:010
25750099220,13cyclictest0-21swapper/022:55:430
257501992112,9cyclictest0-21swapper/123:30:171
257501991912,7cyclictest0-21swapper/119:30:231
25750199190,4cyclictest0-21swapper/119:17:051
25750199190,17cyclictest0-21swapper/123:06:421
25750099190,4cyclictest0-21swapper/020:02:500
25750699189,9cyclictest0-21swapper/221:02:022
257506991815,2cyclictest1026-21snmpd20:44:032
25750199180,3cyclictest0-21swapper/121:31:141
25750199180,3cyclictest0-21swapper/120:14:511
25750199180,3cyclictest0-21swapper/100:23:461
25750199180,17cyclictest0-21swapper/122:37:491
25750099188,9cyclictest0-21swapper/022:41:460
25751199170,3cyclictest0-21swapper/320:37:093
257506991714,2cyclictest1026-21snmpd19:43:242
257506991713,4cyclictest0-21swapper/220:11:512
25750699170,17cyclictest0-21swapper/222:15:202
257501991714,2cyclictest1026-21snmpd21:12:341
25750199170,17cyclictest0-21swapper/119:47:531
25750199170,16cyclictest0-21swapper/120:45:531
25750199170,16cyclictest0-21swapper/100:15:511
25750099170,16cyclictest0-21swapper/022:54:070
25750099170,16cyclictest0-21swapper/022:17:420
25750099170,16cyclictest0-21swapper/021:45:200
25750099170,16cyclictest0-21swapper/019:28:500
25750099170,16cyclictest0-21swapper/019:10:190
25751199167,9cyclictest0-21swapper/320:50:223
25751199166,9cyclictest0-21swapper/300:25:033
257511991612,1cyclictest0-21swapper/319:57:173
257511991611,5cyclictest0-21swapper/322:06:333
25751199160,7cyclictest0-21swapper/322:54:133
25751199160,7cyclictest0-21swapper/322:39:343
25750699167,9cyclictest0-21swapper/220:19:212
25750699166,4cyclictest0-21swapper/219:36:142
257506991615,1cyclictest1026-21snmpd20:03:292
257506991612,4cyclictest0-21swapper/221:17:142
25750699160,7cyclictest0-21swapper/220:47:082
25750699160,7cyclictest0-21swapper/219:47:502
25750699160,16cyclictest0-21swapper/200:37:222
25750199160,8cyclictest0-21swapper/119:50:111
25750199160,2cyclictest0-21swapper/121:01:231
25750199160,1cyclictest0-21swapper/121:56:481
25750199160,1cyclictest0-21swapper/121:15:441
25750199160,16cyclictest0-21swapper/123:49:151
25750199160,16cyclictest0-21swapper/121:38:141
25750199160,16cyclictest0-21swapper/120:51:011
25750199160,15cyclictest0-21swapper/123:00:151
25750099167,9cyclictest0-21swapper/021:39:530
25750099162,6cyclictest0-21swapper/021:41:110
257500991614,1cyclictest0-21swapper/000:00:060
257500991613,2cyclictest1026-21snmpd23:32:290
257500991612,4cyclictest0-21swapper/000:30:180
257500991611,4cyclictest0-21swapper/020:19:270
25750099160,16cyclictest0-21swapper/022:00:190
25750099160,16cyclictest0-21swapper/022:00:190
25750099160,16cyclictest0-21swapper/020:49:520
25750099160,15cyclictest0-21swapper/020:21:520
25751199156,9cyclictest0-21swapper/321:22:113
25751199155,10cyclictest0-21swapper/320:23:293
25751199154,10cyclictest0-21swapper/300:06:303
257511991514,1cyclictest1026-21snmpd22:22:403
257511991513,2cyclictest1026-21snmpd20:15:333
257511991513,1cyclictest1026-21snmpd19:32:463
25751199150,6cyclictest0-21swapper/322:47:133
25751199150,6cyclictest0-21swapper/321:00:433
25751199150,15cyclictest0-21swapper/321:26:593
25750699156,9cyclictest0-21swapper/221:33:532
25750699155,1cyclictest0-21swapper/200:33:572
257506991511,4cyclictest0-21swapper/222:24:012
257506991511,4cyclictest0-21swapper/221:56:182
25750699150,6cyclictest851-21in:imjournal21:24:382
25750699150,6cyclictest0-21swapper/223:42:362
25750699150,6cyclictest0-21swapper/222:47:012
25750699150,6cyclictest0-21swapper/222:12:062
25750699150,6cyclictest0-21swapper/222:05:032
25750699150,6cyclictest0-21swapper/219:51:362
25750699150,15cyclictest0-21swapper/223:25:162
25750699150,15cyclictest0-21swapper/222:29:012
25750699150,15cyclictest0-21swapper/221:36:022
25750199157,8cyclictest0-21swapper/100:33:271
257501991510,5cyclictest0-21swapper/121:47:391
25750199150,6cyclictest0-21swapper/123:17:141
25750199150,6cyclictest0-21swapper/122:22:221
25750199150,6cyclictest0-21swapper/100:10:461
25750199150,15cyclictest0-21swapper/120:31:091
25750199150,15cyclictest0-21swapper/119:40:211
25750099156,9cyclictest0-21swapper/019:30:530
25750099152,13cyclictest0-21swapper/023:47:150
25750099151,6cyclictest0-21swapper/023:51:290
257500991511,4cyclictest0-21swapper/000:09:230
25750099150,7cyclictest0-21swapper/023:56:330
25750099150,6cyclictest0-21swapper/021:18:530
25750099150,6cyclictest0-21swapper/020:10:260
25750099150,6cyclictest0-21swapper/000:28:010
25750099150,6cyclictest0-21swapper/000:21:490
25750099150,15cyclictest0-21swapper/023:20:190
25750099150,14cyclictest0-21swapper/000:15:130
25751199145,9cyclictest0-21swapper/321:30:563
25751199145,9cyclictest0-21swapper/319:23:013
257511991413,1cyclictest1026-21snmpd20:48:343
25751199141,1cyclictest0-21swapper/320:25:093
257511991410,4cyclictest0-21swapper/320:14:003
25751199140,6cyclictest0-21swapper/322:42:013
25750699146,8cyclictest0-21swapper/220:22:272
25750699145,9cyclictest0-21swapper/222:42:572
257506991411,2cyclictest1026-21snmpd00:08:002
25750699140,6cyclictest0-21swapper/220:27:512
25750699140,6cyclictest0-21swapper/200:23:372
25750699140,1cyclictest0-21swapper/220:05:142
25750199145,9cyclictest0-21swapper/100:25:221
257501991412,1cyclictest0-21swapper/121:20:171
257501991412,1cyclictest0-21swapper/119:25:191
25750199140,1cyclictest0-21swapper/121:27:441
25750199140,13cyclictest0-21swapper/122:00:111
25750199140,13cyclictest0-21swapper/122:00:111
25750199140,13cyclictest0-21swapper/119:35:171
257500991410,4cyclictest0-21swapper/000:13:580
25750099140,5cyclictest0-21swapper/023:12:040
25750099140,14cyclictest0-21swapper/019:41:420
112099140,0ntpd0-21swapper/023:35:190
25751199135,8cyclictest0-21swapper/322:16:093
25751199133,9cyclictest0-21swapper/323:57:213
25751199133,9cyclictest0-21swapper/323:06:343
257511991312,1cyclictest0-21swapper/321:35:213
25751199130,13cyclictest0-21swapper/322:00:153
25751199130,13cyclictest0-21swapper/322:00:153
25751199130,13cyclictest0-21swapper/321:14:063
25750699134,9cyclictest0-21swapper/220:38:152
257506991312,1cyclictest0-21swapper/223:45:182
257506991311,2cyclictest0-21swapper/219:55:222
25750699130,13cyclictest0-21swapper/223:35:232
25750699130,13cyclictest0-21swapper/222:00:132
25750699130,13cyclictest0-21swapper/222:00:132
25750199138,1cyclictest0-21swapper/123:21:431
25750199138,1cyclictest0-21swapper/120:06:541
257501991310,2cyclictest1026-21snmpd20:24:311
25750199130,1cyclictest0-21swapper/122:40:181
25750099133,10cyclictest0-21swapper/020:42:360
257500991311,1cyclictest0-21swapper/022:33:570
25750099130,13cyclictest0-21swapper/021:30:180
112099130,0ntpd0-21swapper/321:55:233
25751199129,2cyclictest1026-21snmpd23:15:053
25751199128,4cyclictest0-21swapper/323:45:353
25751199123,9cyclictest0-21swapper/323:26:263
25751199123,9cyclictest0-21swapper/322:55:583
25751199123,9cyclictest0-21swapper/322:27:553
257511991211,1cyclictest0-21swapper/320:06:113
257511991210,1cyclictest1026-21snmpd21:18:443
257511991210,1cyclictest1026-21snmpd20:00:443
25751199120,12cyclictest0-21swapper/321:40:203
25750699129,2cyclictest1026-21snmpd20:32:072
25750699129,2cyclictest1026-21snmpd00:27:132
25750699123,9cyclictest0-21swapper/223:19:112
25750699123,9cyclictest0-21swapper/223:12:322
25750699122,2cyclictest718066-21llvmpipe-322:33:592
25750699121,11cyclictest718066-21llvmpipe-319:24:582
257506991211,1cyclictest0-21swapper/222:50:142
257506991211,1cyclictest0-21swapper/220:55:132
257506991210,1cyclictest1026-21snmpd00:15:092
25750699120,3cyclictest0-21swapper/220:50:312
25750699120,12cyclictest0-21swapper/221:40:232
25750699120,12cyclictest0-21swapper/221:25:202
25750699120,11cyclictest718064-21llvmpipe-119:25:592
25750199129,2cyclictest1026-21snmpd23:53:381
25750199129,2cyclictest1026-21snmpd23:25:051
25750199129,2cyclictest1026-21snmpd23:13:441
25750199129,2cyclictest1026-21snmpd19:57:441
25750199127,4cyclictest0-21swapper/122:33:161
257501991211,1cyclictest0-21swapper/123:37:561
25750199120,1cyclictest0-21swapper/122:55:211
25750099129,2cyclictest1026-21snmpd22:22:430
25750099129,2cyclictest1026-21snmpd21:28:230
25750099129,2cyclictest1026-21snmpd20:34:450
25750099123,9cyclictest0-21swapper/023:19:560
25750099123,9cyclictest0-21swapper/020:51:490
25750099123,9cyclictest0-21swapper/019:16:410
25750099122,9cyclictest366445-21ntpq23:40:180
25750099122,10cyclictest0-21swapper/020:59:250
229699120,2rtkit-daemon2295-21rtkit-daemon23:07:292
229699120,2rtkit-daemon2295-21rtkit-daemon20:29:250
112099120,1ntpd0-21swapper/119:10:201
25751199119,1cyclictest1026-21snmpd23:50:063
25751199117,4cyclictest0-21swapper/322:12:213
257511991110,1cyclictest1026-21snmpd23:12:143
25751199110,11cyclictest0-21swapper/323:21:313
25751199110,10cyclictest0-21swapper/319:10:173
25750699119,2cyclictest1026-21snmpd21:07:282
25750699119,2cyclictest0-21swapper/200:10:152
25750699118,2cyclictest718065-21llvmpipe-223:22:582
25750699118,2cyclictest260568-21fschecks_count19:15:132
25750699118,2cyclictest1026-21snmpd00:02:352
25750199119,1cyclictest336799-21chrt22:25:221
25750199118,2cyclictest1026-21snmpd21:05:341
25750199118,2cyclictest1026-21snmpd20:59:011
25750199118,2cyclictest1026-21snmpd20:01:291
25750199113,8cyclictest0-21swapper/123:43:271
25750199110,1cyclictest0-21swapper/100:05:201
25750199110,10cyclictest0-21swapper/123:58:211
25750099119,1cyclictest1026-21snmpd21:12:520
25750099118,2cyclictest1026-21snmpd23:02:590
25750099118,2cyclictest1026-21snmpd19:20:100
25750099118,2cyclictest1026-21snmpd00:35:490
25750099117,1cyclictest0-21swapper/023:08:050
257500991110,1cyclictest0-21swapper/022:25:520
257500991110,1cyclictest0-21swapper/021:00:290
25750099110,10cyclictest0-21swapper/021:57:270
25751199109,1cyclictest1026-21snmpd23:36:333
25751199109,1cyclictest1026-21snmpd23:03:473
25751199109,1cyclictest1026-21snmpd19:25:323
25751199109,1cyclictest1026-21snmpd19:19:583
25751199109,1cyclictest0-21swapper/320:33:463
25751199109,1cyclictest0-21swapper/300:21:343
25751199108,2cyclictest1026-21snmpd19:45:233
25751199107,2cyclictest1026-21snmpd00:36:583
25751199100,10cyclictest0-21swapper/321:49:273
25751199100,10cyclictest0-21swapper/319:43:293
25750699108,2cyclictest718064-21llvmpipe-122:36:592
25750699107,2cyclictest1026-21snmpd21:10:462
25750699100,9cyclictest718049-21gnome-shell21:54:592
25750699100,9cyclictest0-21swapper/223:50:032
25750699100,10cyclictest718064-21llvmpipe-119:12:592
25750199109,1cyclictest0-21swapper/119:20:211
25750199108,2cyclictest1026-21snmpd22:15:591
25750199108,1cyclictest1026-21snmpd22:07:181
25750199107,2cyclictest1026-21snmpd22:53:551
25750199107,2cyclictest1026-21snmpd22:45:431
25750199107,2cyclictest1026-21snmpd21:50:421
25750199107,2cyclictest1026-21snmpd21:42:351
25750199106,4cyclictest0-21swapper/120:40:331
25750199100,9cyclictest0-21swapper/120:35:061
25750099109,1cyclictest0-21swapper/022:10:360
25750099108,1cyclictest276549-21fschecks_time19:55:180
25750099107,2cyclictest268467-21df_abs19:35:110
25750099107,2cyclictest1026-21snmpd22:45:490
25750099107,2cyclictest1026-21snmpd21:51:030
25750099100,4cyclictest0-21swapper/019:52:080
25750099100,10cyclictest0-21swapper/022:09:150
2575119997,2cyclictest1026-21snmpd22:32:403
2575119997,2cyclictest1026-21snmpd21:06:503
2575119997,2cyclictest1026-21snmpd00:16:153
2575119997,1cyclictest1026-21snmpd19:50:063
2575119996,2cyclictest1026-21snmpd20:55:043
2575119996,2cyclictest1026-21snmpd20:40:483
2575119994,5cyclictest0-21swapper/300:00:083
2575119990,9cyclictest0-21swapper/319:35:543
2575119990,9cyclictest0-21swapper/300:10:343
2575069998,1cyclictest0-21swapper/223:55:222
2575069997,1cyclictest1026-21snmpd19:31:312
2575069996,2cyclictest347689-21/usr/sbin/munin22:55:112
2575069990,9cyclictest718064-21llvmpipe-121:47:582
2575019996,2cyclictest1026-21snmpd00:00:081
2575019990,1cyclictest0-21swapper/120:28:211
2575009996,2cyclictest292407-21fschecks_count20:35:130
2575009995,4cyclictest0-21swapper/022:38:070
2575009995,4cyclictest0-21swapper/021:23:560
2575009990,9cyclictest0-21swapper/020:08:500
2575119987,1cyclictest1026-21snmpd23:44:333
2575069985,2cyclictest1026-21snmpd23:02:112
11209980,1ntpd386340-21ntpq00:30:203
11209980,1ntpd330658-21ntpq22:10:171
11209980,1ntpd0-21swapper/321:50:183
11209980,1ntpd0-21swapper/100:35:211
2575009965,1cyclictest0-21swapper/019:48:230
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional