You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-12 - 10:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Tue Nov 12, 2024 00:43:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
20851991919,0cyclictest61550irq/125-lan23:35:202
20851991918,1cyclictest61550irq/125-lan00:10:172
20851991918,1cyclictest61550irq/125-lan00:06:182
20851991818,0cyclictest61550irq/125-lan23:20:132
20851991818,0cyclictest61550irq/125-lan22:16:392
20851991818,0cyclictest61550irq/125-lan21:59:162
20851991818,0cyclictest61550irq/125-lan00:39:202
20851991818,0cyclictest61550irq/125-lan00:30:482
20851991818,0cyclictest61550irq/125-lan00:25:092
20851991817,1cyclictest61550irq/125-lan23:55:142
20851991817,1cyclictest61550irq/125-lan23:52:222
20851991817,1cyclictest61550irq/125-lan23:43:432
20851991817,1cyclictest61550irq/125-lan22:59:582
20851991817,1cyclictest61550irq/125-lan22:47:552
20851991817,1cyclictest61550irq/125-lan22:30:302
20851991817,1cyclictest61550irq/125-lan22:05:142
20851991817,1cyclictest61550irq/125-lan21:50:222
20851991817,1cyclictest61550irq/125-lan21:40:212
20851991817,1cyclictest61550irq/125-lan21:37:342
20851991817,1cyclictest61550irq/125-lan21:31:022
20851991817,1cyclictest61550irq/125-lan21:25:162
20851991817,1cyclictest61550irq/125-lan21:20:162
20851991817,1cyclictest61550irq/125-lan00:20:172
20844991818,0cyclictest716-21snmpd20:17:180
20844991818,0cyclictest716-21snmpd19:45:560
20851991717,0cyclictest61550irq/125-lan23:46:042
20851991717,0cyclictest61550irq/125-lan23:10:342
20851991717,0cyclictest61550irq/125-lan22:20:282
20851991717,0cyclictest61550irq/125-lan22:00:162
20851991717,0cyclictest61550irq/125-lan21:18:242
20851991716,1cyclictest61550irq/125-lan23:29:402
20851991716,1cyclictest61550irq/125-lan23:07:032
20851991716,1cyclictest61550irq/125-lan23:00:222
20851991716,1cyclictest61550irq/125-lan22:51:322
20851991716,1cyclictest61550irq/125-lan22:41:512
20851991716,1cyclictest61550irq/125-lan22:35:142
20851991716,1cyclictest61550irq/125-lan21:45:382
20851991716,1cyclictest61550irq/125-lan21:12:472
20851991716,1cyclictest61550irq/125-lan20:55:282
20851991716,1cyclictest61550irq/125-lan20:35:162
20851991716,1cyclictest61550irq/125-lan19:50:182
20851991716,1cyclictest61550irq/125-lan19:45:012
20851991716,1cyclictest61550irq/125-lan19:15:182
20851991716,1cyclictest61550irq/125-lan19:10:192
20851991716,1cyclictest61550irq/125-lan00:04:422
20851991715,1cyclictest61550irq/125-lan22:12:032
20844991717,0cyclictest716-21snmpd22:48:390
20844991717,0cyclictest716-21snmpd21:14:590
20844991717,0cyclictest716-21snmpd20:55:340
20844991717,0cyclictest716-21snmpd00:01:150
20851991616,0cyclictest61550irq/125-lan23:17:182
20851991616,0cyclictest61550irq/125-lan22:25:102
20851991615,1cyclictest61550irq/125-lan23:30:032
20851991615,1cyclictest61550irq/125-lan00:15:172
20844991616,0cyclictest716-21snmpd23:16:260
20844991616,0cyclictest716-21snmpd21:44:040
20844991616,0cyclictest716-21snmpd20:24:120
20844991616,0cyclictest716-21snmpd19:33:550
20844991616,0cyclictest716-21snmpd19:21:120
20844991616,0cyclictest716-21snmpd00:25:460
20844991616,0cyclictest25999-21cat21:30:210
20851991515,0cyclictest61550irq/125-lan20:40:152
20851991515,0cyclictest61550irq/125-lan20:30:132
20851991515,0cyclictest61550irq/125-lan20:00:212
20851991515,0cyclictest61550irq/125-lan19:45:092
20851991515,0cyclictest61550irq/125-lan19:35:122
20851991515,0cyclictest331-21hwrng19:20:352
20851991514,1cyclictest61550irq/125-lan21:05:192
20851991514,1cyclictest61550irq/125-lan20:45:202
20851991514,1cyclictest61550irq/125-lan20:25:212
20844991515,0cyclictest716-21snmpd21:16:110
20844991515,0cyclictest716-21snmpd00:35:010
20844991515,0cyclictest716-21snmpd00:15:580
20844991515,0cyclictest331-21hwrng22:51:310
20844991515,0cyclictest31750-21cat19:35:150
20844991515,0cyclictest26636-21cat23:10:190
20844991514,1cyclictest331-21hwrng21:55:110
20844991514,0cyclictest331-21hwrng22:57:400
20851991414,0cyclictest61550irq/125-lan20:05:232
20851991413,1cyclictest61550irq/125-lan20:10:192
20844991414,0cyclictest331-21hwrng23:45:480
20844991414,0cyclictest331-21hwrng22:42:180
20844991414,0cyclictest331-21hwrng21:21:240
20851991312,1cyclictest61550irq/125-lan21:00:102
20848991313,0cyclictest331-21hwrng19:24:401
20844991313,0cyclictest331-21hwrng23:59:050
20844991313,0cyclictest331-21hwrng23:51:560
20844991313,0cyclictest331-21hwrng23:40:400
20844991313,0cyclictest331-21hwrng23:33:300
20844991313,0cyclictest331-21hwrng21:36:450
20844991313,0cyclictest331-21hwrng00:34:560
20851991212,0cyclictest61550irq/125-lan20:20:272
20851991212,0cyclictest61550irq/125-lan20:16:082
20848991212,0cyclictest331-21hwrng23:17:071
20848991212,0cyclictest331-21hwrng22:00:191
20844991212,0cyclictest331-21hwrng23:35:330
20844991212,0cyclictest331-21hwrng22:37:110
20844991212,0cyclictest331-21hwrng22:10:330
20844991212,0cyclictest331-21hwrng22:08:310
20844991210,0cyclictest331-21hwrng22:34:060
20851991111,0cyclictest61550irq/125-lan19:55:202
20851991110,1cyclictest61550irq/125-lan19:25:202
20848991111,0cyclictest331-21hwrng20:17:561
20848991110,1cyclictest716-21snmpd22:06:321
20844991111,0cyclictest331-21hwrng23:20:110
20844991111,0cyclictest331-21hwrng23:00:440
20844991111,0cyclictest331-21hwrng22:25:550
20844991111,0cyclictest331-21hwrng22:15:410
20844991111,0cyclictest331-21hwrng22:00:190
20844991111,0cyclictest331-21hwrng21:07:050
20844991111,0cyclictest331-21hwrng21:02:580
20844991111,0cyclictest331-21hwrng20:14:500
20844991111,0cyclictest331-21hwrng19:25:420
2085199109,1cyclictest61550irq/125-lan20:50:142
20844991010,0cyclictest331-21hwrng20:35:200
20844991010,0cyclictest331-21hwrng19:52:190
208449999,0cyclictest331-21hwrng21:51:070
208549988,0cyclictest716-21snmpd22:57:503
208549988,0cyclictest716-21snmpd21:27:443
208549988,0cyclictest716-21snmpd21:09:223
208549988,0cyclictest716-21snmpd20:51:463
208549988,0cyclictest716-21snmpd19:46:583
208549988,0cyclictest716-21snmpd19:10:323
208549988,0cyclictest716-21snmpd00:34:133
208549988,0cyclictest331-21hwrng21:16:173
208519988,0cyclictest61550irq/125-lan19:30:222
208489988,0cyclictest716-21snmpd23:34:241
208489988,0cyclictest716-21snmpd21:28:591
208489988,0cyclictest716-21snmpd20:00:381
208489988,0cyclictest714-21lldpd23:10:191
208449988,0cyclictest716-21snmpd23:26:090
208449988,0cyclictest716-21snmpd23:06:580
208549977,0cyclictest716-21snmpd23:56:213
208549977,0cyclictest716-21snmpd23:43:003
208549977,0cyclictest716-21snmpd23:39:023
208549977,0cyclictest716-21snmpd23:34:543
208549977,0cyclictest716-21snmpd22:50:433
208549977,0cyclictest716-21snmpd22:21:333
208549976,1cyclictest716-21snmpd23:23:443
208549976,1cyclictest716-21snmpd23:17:013
208549976,1cyclictest716-21snmpd22:30:013
208549976,1cyclictest716-21snmpd22:04:273
208549976,1cyclictest716-21snmpd21:56:393
208549976,1cyclictest716-21snmpd21:20:533
208549976,1cyclictest716-21snmpd20:01:353
208549975,2cyclictest716-21snmpd21:49:123
208489977,0cyclictest716-21snmpd23:45:331
208489977,0cyclictest716-21snmpd23:41:421
208489977,0cyclictest716-21snmpd23:00:401
208489977,0cyclictest716-21snmpd22:36:401
208489977,0cyclictest716-21snmpd21:57:351
208489977,0cyclictest716-21snmpd21:06:311
208489977,0cyclictest716-21snmpd20:34:541
208489977,0cyclictest716-21snmpd20:11:521
208489977,0cyclictest716-21snmpd19:41:071
208489977,0cyclictest716-21snmpd19:13:281
208489976,1cyclictest716-21snmpd23:23:581
208489976,1cyclictest716-21snmpd22:28:271
208489976,1cyclictest716-21snmpd00:26:401
208449977,0cyclictest716-21snmpd21:49:570
208449977,0cyclictest716-21snmpd19:10:150
208449976,1cyclictest716-21snmpd00:14:280
208549966,0cyclictest716-21snmpd21:50:383
208549966,0cyclictest716-21snmpd21:36:073
208549966,0cyclictest716-21snmpd19:44:083
208549966,0cyclictest716-21snmpd19:15:573
208549966,0cyclictest716-21snmpd00:20:133
208549965,1cyclictest716-21snmpd20:06:433
208549965,1cyclictest716-21snmpd19:24:493
208489966,0cyclictest716-21snmpd20:52:041
208489966,0cyclictest716-21snmpd19:48:531
208489966,0cyclictest716-21snmpd19:31:581
208489965,1cyclictest716-21snmpd22:32:311
208489965,1cyclictest716-21snmpd20:57:581
208489965,1cyclictest25137-21cat00:15:141
208489965,1cyclictest11236-21cat21:15:131
208449966,0cyclictest716-21snmpd20:42:300
208449966,0cyclictest716-21snmpd00:21:040
208549955,0cyclictest716-21snmpd21:11:343
208549955,0cyclictest716-21snmpd00:11:033
208549955,0cyclictest716-21snmpd00:09:013
208549954,1cyclictest716-21snmpd23:02:013
208549954,1cyclictest716-21snmpd22:44:303
208549954,1cyclictest716-21snmpd19:33:273
208549953,2cyclictest716-21snmpd23:50:563
208549953,2cyclictest716-21snmpd23:28:033
208549953,2cyclictest716-21snmpd22:07:203
208549953,2cyclictest631-21ntpq22:10:213
208489955,0cyclictest716-21snmpd19:58:351
208489955,0cyclictest716-21snmpd19:52:341
208489954,1cyclictest716-21snmpd23:29:391
208489954,1cyclictest716-21snmpd20:21:391
208489954,1cyclictest716-21snmpd19:39:451
208489954,1cyclictest716-21snmpd00:23:551
208489954,1cyclictest716-21snmpd00:09:491
208489953,2cyclictest716-21snmpd22:22:461
208489953,2cyclictest716-21snmpd20:48:211
208449955,0cyclictest716-21snmpd20:09:080
208449954,1cyclictest716-21snmpd00:05:280
208549944,0cyclictest716-21snmpd23:11:053
208549944,0cyclictest716-21snmpd20:58:453
208549944,0cyclictest716-21snmpd20:21:593
208549944,0cyclictest331-21hwrng22:37:113
208549944,0cyclictest331-21hwrng20:45:343
208549944,0cyclictest331-21hwrng20:41:283
208549944,0cyclictest331-21hwrng20:18:573
208549944,0cyclictest331-21hwrng20:12:483
208549943,1cyclictest716-21snmpd22:17:123
208549943,1cyclictest716-21snmpd20:39:333
208549943,1cyclictest716-21snmpd20:27:413
208549943,1cyclictest431ktimers/322:27:253
208549943,1cyclictest431ktimers/300:36:243
208549943,1cyclictest3507-21ntpq21:40:203
208549943,1cyclictest22275-21ntpq20:30:183
208549943,1cyclictest0-21swapper/321:34:593
208549942,2cyclictest716-21snmpd23:07:023
208549942,2cyclictest716-21snmpd19:59:143
208549942,2cyclictest24872-21ssh00:15:133
208549942,2cyclictest2266-21cat21:00:133
208549940,2cyclictest5851-21awk22:50:003
208489944,0cyclictest331-21hwrng23:56:011
208489944,0cyclictest331-21hwrng23:35:321
208489944,0cyclictest331-21hwrng22:59:431
208489944,0cyclictest331-21hwrng21:53:081
208489944,0cyclictest331-21hwrng21:41:541
208489944,0cyclictest331-21hwrng21:35:441
208489944,0cyclictest331-21hwrng21:10:091
208489944,0cyclictest331-21hwrng20:40:261
208489944,0cyclictest331-21hwrng19:16:281
208489944,0cyclictest331-21hwrng00:37:001
208489944,0cyclictest331-21hwrng00:10:211
208489944,0cyclictest331-21hwrng00:01:091
208489943,1cyclictest716-21snmpd23:06:381
208489943,1cyclictest716-21snmpd22:54:081
208489943,1cyclictest271ktimers/122:45:231
208489943,1cyclictest271ktimers/100:30:251
208489943,1cyclictest1927-21cpuspeed_turbos21:00:111
208489942,2cyclictest716-21snmpd22:40:491
208489942,2cyclictest32104-21ssh22:10:121
208489942,2cyclictest27830-21cat19:25:141
208489942,2cyclictest24381-21cat20:35:151
208489942,2cyclictest10606-21ssh21:48:041
208449943,1cyclictest716-21snmpd20:27:050
208449943,1cyclictest10975-21users20:00:220
208449943,0cyclictest14-21ksoftirqd/020:30:170
208449942,0cyclictest0-21swapper/019:44:560
208449940,1cyclictest9398-21awk20:00:000
208549933,0cyclictest331-21hwrng19:39:003
208549932,1cyclictest431ktimers/323:45:163
208549932,1cyclictest27810-21cat19:25:143
208549931,2cyclictest6099-21sh19:50:183
208549931,2cyclictest2075-21df_inode00:25:123
208549931,2cyclictest13763-21rm00:03:373
208489933,0cyclictest331-21hwrng20:26:061
208489933,0cyclictest331-21hwrng20:05:371
208489932,1cyclictest5570-21kworker/u8:3+nfsiod22:15:311
208489932,1cyclictest0-21swapper/121:20:151
208489931,2cyclictest631-21df23:50:141
208489930,2cyclictest25344-21ssh21:30:031
208449932,1cyclictest716-21snmpd20:45:210
208449932,1cyclictest151ktimers/022:20:510
208449932,1cyclictest0-21swapper/020:50:130
208449931,2cyclictest23716-21ld19:15:160
208449930,1cyclictest171rcu_preempt21:25:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional