You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-27 - 08:13

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot7s.osadl.org (updated Sat Apr 27, 2024 00:43:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2196258211871,20sleep10-21swapper/119:08:381
2196100211464,20sleep00-21swapper/019:06:410
2196035211365,18sleep20-21swapper/219:05:502
2196207211269,36sleep30-21swapper/319:08:003
219650599560,35cyclictest0-21swapper/219:17:042
112099280,3ntpd2323343-21ntpq00:25:191
112099280,3ntpd2283554-21ntpq22:45:193
112099200,2ntpd2255780-21ntpq21:35:181
2196505991918,1cyclictest0-21swapper/220:10:352
229699170,2rtkit-daemon2295-21rtkit-daemon19:26:342
2196505991716,1cyclictest1026-21snmpd21:04:312
219650899167,9cyclictest0-21swapper/300:11:523
219650899160,15cyclictest0-21swapper/319:56:223
2196505991615,1cyclictest1026-21snmpd21:09:102
2196505991615,1cyclictest1026-21snmpd20:43:352
2196503991614,1cyclictest1026-21snmpd23:22:021
2196503991614,1cyclictest1026-21snmpd19:14:531
229699150,2rtkit-daemon2295-21rtkit-daemon23:09:093
219650899156,9cyclictest0-21swapper/323:32:333
219650899155,9cyclictest0-21swapper/321:11:093
219650899150,15cyclictest0-21swapper/319:47:223
219650399150,7cyclictest0-21swapper/122:06:341
219649899152,13cyclictest0-21swapper/020:39:090
2196498991515,0cyclictest0-21swapper/022:31:060
219649899150,15cyclictest0-21swapper/023:30:200
219649899150,15cyclictest0-21swapper/020:43:390
112099150,3ntpd0-21swapper/322:30:203
219650899146,8cyclictest0-21swapper/320:22:443
219650899145,9cyclictest0-21swapper/322:22:543
219650899145,9cyclictest0-21swapper/319:34:333
2196508991412,1cyclictest1026-21snmpd20:55:183
2196503991411,2cyclictest1026-21snmpd19:56:221
219650399140,1cyclictest0-21swapper/123:05:171
219650399140,13cyclictest0-21swapper/119:50:121
219649899146,8cyclictest0-21swapper/019:27:260
219649899145,9cyclictest0-21swapper/023:46:570
219649899145,9cyclictest0-21swapper/020:29:020
2196498991414,0cyclictest0-21swapper/019:36:270
112099140,0ntpd0-21swapper/319:40:203
219650899134,9cyclictest0-21swapper/322:54:253
219650899134,9cyclictest0-21swapper/300:34:043
2196508991312,1cyclictest0-21swapper/321:28:493
2196508991312,1cyclictest0-21swapper/320:50:333
219650899130,4cyclictest0-21swapper/322:01:053
2196505991311,1cyclictest1026-21snmpd23:30:202
2196503991311,1cyclictest1026-21snmpd23:10:051
219650399130,1cyclictest0-21swapper/119:45:221
219650399130,13cyclictest0-21swapper/120:55:151
219649899134,9cyclictest0-21swapper/023:43:300
219649899134,9cyclictest0-21swapper/021:34:200
219649899134,9cyclictest0-21swapper/020:55:370
219649899134,9cyclictest0-21swapper/020:17:320
219649899134,9cyclictest0-21swapper/000:33:430
2196498991312,1cyclictest0-21swapper/021:40:040
2196498991312,1cyclictest0-21swapper/021:05:220
219649899130,4cyclictest0-21swapper/023:35:480
219649899130,1cyclictest0-21swapper/023:58:360
112099130,4ntpd0-21swapper/122:40:171
219650899129,2cyclictest1026-21snmpd22:05:063
219650899129,2cyclictest1026-21snmpd21:59:023
219650899129,2cyclictest1026-21snmpd21:09:453
219650899129,2cyclictest1026-21snmpd20:12:113
219650899129,2cyclictest1026-21snmpd19:21:233
219650899123,9cyclictest0-21swapper/321:47:383
219650899123,9cyclictest0-21swapper/321:47:383
2196508991210,1cyclictest0-21swapper/322:25:003
219650599129,2cyclictest1026-21snmpd23:26:202
219650599129,2cyclictest1026-21snmpd21:36:042
219650599129,2cyclictest1026-21snmpd21:10:032
219650599129,2cyclictest1026-21snmpd20:29:022
2196505991211,1cyclictest1026-21snmpd21:53:272
2196505991210,1cyclictest1026-21snmpd23:58:362
219650599120,12cyclictest0-21swapper/222:25:182
219650399129,2cyclictest1026-21snmpd23:29:111
2196503991210,1cyclictest1026-21snmpd23:43:481
2196503991210,1cyclictest1026-21snmpd20:02:011
219650399120,12cyclictest0-21swapper/122:25:101
219649899129,2cyclictest1026-21snmpd20:47:410
219649899129,2cyclictest1026-21snmpd20:24:040
219649899123,9cyclictest0-21swapper/021:26:280
2196498991211,1cyclictest1026-21snmpd21:36:260
2196498991211,1cyclictest0-21swapper/020:08:550
2196498991211,1cyclictest0-21swapper/000:17:070
219649899120,12cyclictest0-21swapper/022:51:220
229699110,1rtkit-daemon2295-21rtkit-daemon23:47:541
219650899119,1cyclictest1026-21snmpd23:40:213
219650899119,1cyclictest1026-21snmpd21:22:523
219650899119,1cyclictest1026-21snmpd19:51:393
219650899119,1cyclictest1026-21snmpd00:05:513
219650899118,2cyclictest1026-21snmpd21:50:123
219650899118,2cyclictest1026-21snmpd00:22:073
219650899112,9cyclictest0-21swapper/320:43:173
219650899110,10cyclictest0-21swapper/323:11:503
219650899110,10cyclictest0-21swapper/322:57:163
219650599118,2cyclictest2325802-21unixbench_singl00:30:252
219650599118,2cyclictest1026-21snmpd23:38:482
219650599118,2cyclictest1026-21snmpd21:31:382
219650599118,2cyclictest1026-21snmpd20:55:362
219650599118,2cyclictest1026-21snmpd19:44:282
219650599118,2cyclictest1026-21snmpd00:36:382
2196505991110,1cyclictest1026-21snmpd22:53:282
2196505991110,1cyclictest1026-21snmpd21:40:492
2196505991110,1cyclictest1026-21snmpd20:36:302
2196505991110,1cyclictest0-21swapper/223:00:312
219650599110,11cyclictest0-21swapper/222:05:192
219650399119,2cyclictest1026-21snmpd00:19:401
219650399119,1cyclictest1026-21snmpd23:53:481
219650399119,1cyclictest1026-21snmpd20:37:511
219650399118,2cyclictest1026-21snmpd22:35:401
219650399118,2cyclictest1026-21snmpd21:08:371
219650399118,2cyclictest1026-21snmpd20:22:441
219650399110,1cyclictest0-21swapper/120:47:231
219650399110,11cyclictest0-21swapper/119:22:061
219649899119,1cyclictest2221709-21awk20:10:130
219649899119,1cyclictest1026-21snmpd22:47:100
219649899119,1cyclictest1026-21snmpd00:36:040
219649899112,9cyclictest0-21swapper/022:22:190
2196498991110,1cyclictest1026-21snmpd21:10:240
2196498991110,1cyclictest1026-21snmpd20:30:260
2196498991110,1cyclictest0-21swapper/023:19:510
2196498991110,1cyclictest0-21swapper/020:02:400
219649899110,1cyclictest191rcu_preempt23:26:170
219649899110,0cyclictest191rcu_preempt19:12:360
112099110,5ntpd2229924-21ntpq20:30:173
112099110,1ntpd391rcuc/220:05:172
112099110,0ntpd0-21swapper/121:40:171
219650899108,1cyclictest1026-21snmpd23:20:053
219650899108,1cyclictest1026-21snmpd20:08:083
219650899107,2cyclictest1026-21snmpd23:01:253
219650899107,2cyclictest1026-21snmpd22:41:073
219650899107,2cyclictest1026-21snmpd20:15:013
219650899104,5cyclictest0-21swapper/300:01:303
219650899100,9cyclictest0-21swapper/323:15:053
219650899100,10cyclictest0-21swapper/322:35:403
219650899100,10cyclictest0-21swapper/322:15:193
219650899100,10cyclictest0-21swapper/321:16:343
219650899100,10cyclictest0-21swapper/320:26:233
219650899100,10cyclictest0-21swapper/319:28:553
219650599109,1cyclictest1026-21snmpd23:46:572
219650599109,1cyclictest1026-21snmpd23:21:292
219650599109,1cyclictest1026-21snmpd23:17:412
219650599109,1cyclictest1026-21snmpd22:31:512
219650599109,1cyclictest1026-21snmpd22:12:212
219650599109,1cyclictest1026-21snmpd20:19:282
219650599109,1cyclictest0-21swapper/223:53:032
219650599109,1cyclictest0-21swapper/220:47:112
219650599108,2cyclictest1026-21snmpd23:43:312
219650599108,2cyclictest1026-21snmpd22:44:192
219650599108,2cyclictest1026-21snmpd21:46:062
219650599108,2cyclictest1026-21snmpd21:46:052
219650599108,1cyclictest1026-21snmpd22:24:192
219650599107,1cyclictest1026-21snmpd19:12:352
219650599100,10cyclictest0-21swapper/200:11:042
219650399109,1cyclictest1026-21snmpd20:43:001
219650399109,1cyclictest0-21swapper/121:14:211
219650399109,1cyclictest0-21swapper/119:27:501
219650399108,2cyclictest1026-21snmpd22:52:431
219650399108,1cyclictest1026-21snmpd23:32:331
219650399108,1cyclictest1026-21snmpd22:15:181
219650399108,1cyclictest1026-21snmpd21:33:171
219650399108,1cyclictest1026-21snmpd19:30:061
219650399107,2cyclictest1026-21snmpd23:15:051
219650399107,2cyclictest1026-21snmpd22:21:581
219650399107,2cyclictest1026-21snmpd22:04:081
219650399107,2cyclictest1026-21snmpd20:19:461
219650399107,2cyclictest1026-21snmpd00:34:041
219650399107,2cyclictest1026-21snmpd00:10:401
219650399100,9cyclictest2283554-21ntpq22:45:181
219650399100,1cyclictest0-21swapper/100:23:271
219650399100,10cyclictest0-21swapper/122:56:071
219650399100,10cyclictest0-21swapper/120:27:441
219649899109,1cyclictest1026-21snmpd21:51:110
219649899109,1cyclictest1026-21snmpd21:21:170
219649899109,1cyclictest1026-21snmpd19:45:010
219649899109,1cyclictest1026-21snmpd19:19:510
219649899109,1cyclictest1026-21snmpd00:03:510
219649899109,1cyclictest0-21swapper/023:01:530
219649899108,2cyclictest1026-21snmpd00:20:370
219649899108,1cyclictest1026-21snmpd21:03:180
219649899108,1cyclictest1026-21snmpd20:51:360
219649899107,2cyclictest1026-21snmpd23:52:120
219649899100,2cyclictest718063-21llvmpipe-021:15:580
219649899100,10cyclictest0-21swapper/022:25:420
219649899100,10cyclictest0-21swapper/021:45:510
219649899100,10cyclictest0-21swapper/021:45:500
112099100,1ntpd0-21swapper/220:50:182
21965089997,1cyclictest1026-21snmpd23:55:303
21965089997,1cyclictest1026-21snmpd19:37:143
21965089997,1cyclictest1026-21snmpd00:35:383
21965089997,1cyclictest0-21swapper/320:35:123
21965089996,3cyclictest2319322-21ntpq00:15:153
21965089996,2cyclictest1026-21snmpd23:47:303
21965089996,2cyclictest1026-21snmpd22:13:453
21965089996,2cyclictest1026-21snmpd00:27:523
21965089995,4cyclictest0-21swapper/320:00:213
21965089990,9cyclictest0-21swapper/323:35:363
21965089990,9cyclictest0-21swapper/323:26:303
21965089990,9cyclictest0-21swapper/321:36:163
21965089990,9cyclictest0-21swapper/321:30:443
21965089990,9cyclictest0-21swapper/321:02:103
21965089990,9cyclictest0-21swapper/320:47:003
21965089990,9cyclictest0-21swapper/319:17:423
21965089990,9cyclictest0-21swapper/319:11:153
21965059998,1cyclictest1026-21snmpd23:07:442
21965059998,1cyclictest1026-21snmpd22:58:492
21965059998,1cyclictest1026-21snmpd21:26:282
21965059998,1cyclictest1026-21snmpd20:32:052
21965059998,1cyclictest1026-21snmpd00:05:362
21965059997,2cyclictest2212432-21unixbench_multi19:45:212
21965059997,2cyclictest1026-21snmpd21:22:312
21965059997,2cyclictest1026-21snmpd19:22:092
21965059997,1cyclictest1018-21nmbd22:39:042
21965059996,2cyclictest2215067-21latency_hist19:54:582
21965039998,1cyclictest1026-21snmpd21:03:031
21965039997,2cyclictest1026-21snmpd23:35:361
21965039997,2cyclictest1026-21snmpd21:47:451
21965039997,2cyclictest1026-21snmpd21:47:441
21965039997,1cyclictest1026-21snmpd21:21:021
21965039996,2cyclictest2222373-21unixbench_multi20:10:221
21965039996,2cyclictest1026-21snmpd22:34:241
21965039990,9cyclictest0-21swapper/120:32:581
21964989999,0cyclictest0-21swapper/019:21:150
21964989998,1cyclictest1026-21snmpd19:41:310
21964989998,1cyclictest1026-21snmpd00:29:100
21964989998,1cyclictest1026-21snmpd00:08:010
21964989998,1cyclictest0-21swapper/000:11:310
21964989997,1cyclictest2268615-21latency_hist22:09:590
21964989994,5cyclictest0-21swapper/021:56:300
21964989990,9cyclictest0-21swapper/023:21:290
21964989990,9cyclictest0-21swapper/023:12:290
21964989990,9cyclictest0-21swapper/023:07:110
21964989990,9cyclictest0-21swapper/022:58:490
21964989990,9cyclictest0-21swapper/022:44:190
21964989990,3cyclictest0-21swapper/019:58:130
21964989990,1cyclictest0-21swapper/022:39:050
11209990,2ntpd2226863-21date20:24:592
11209990,2ntpd2198705-21perl19:14:591
11209990,0ntpd0-21swapper/100:35:171
21965089987,1cyclictest0-21swapper/321:43:593
21965059987,1cyclictest2263699-21ntpq21:55:152
21965059987,1cyclictest1026-21snmpd00:19:582
21965059986,2cyclictest1026-21snmpd19:56:012
21965059980,8cyclictest0-21swapper/222:18:582
21965059980,8cyclictest0-21swapper/221:15:592
21965059980,8cyclictest0-21swapper/219:35:202
21965039988,0cyclictest0-21swapper/120:05:581
21965039986,2cyclictest2209789-21awk19:40:161
21965039986,2cyclictest1026-21snmpd22:12:571
21965039980,8cyclictest0-21swapper/123:56:581
21964989986,1cyclictest2205570-21tune2fs19:30:110
21964989986,1cyclictest1026-21snmpd19:52:420
21964989982,6cyclictest0-21swapper/022:11:000
11209980,1ntpd0-21swapper/121:55:161
11209980,0ntpd0-21swapper/223:10:212
11209980,0ntpd0-21swapper/121:25:171
11209980,0ntpd0-21swapper/121:15:151
11209980,0ntpd0-21swapper/119:35:161
21965059976,1cyclictest2323231-21sed00:25:162
21965059975,1cyclictest1026-21snmpd22:01:562
21965059973,3cyclictest2312587-21grep00:00:102
21965059970,6cyclictest2320460-21/usr/sbin/munin00:20:152
21965059970,6cyclictest2217098-21/usr/sbin/munin20:00:102
21965059970,2cyclictest0-21swapper/219:34:162
21965059970,1cyclictest0-21swapper/222:45:182
21964989974,2cyclictest1026-21snmpd22:01:170
21964989970,7cyclictest0-21swapper/022:15:420
11209970,0ntpd0-21swapper/323:50:163
11209970,0ntpd0-21swapper/123:00:181
11209970,0ntpd0-21swapper/121:50:181
11209970,0ntpd0-21swapper/100:05:161
11209970,0ntpd0-21swapper/100:00:181
21965039960,1cyclictest0-21swapper/120:50:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional