You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-27 - 05:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack8slot6s.osadl.org (updated Sat Jun 27, 2026 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6559991918,1cyclictest65850irq/126-lan23:24:260
6559991818,0cyclictest65850irq/126-lan20:05:200
6559991817,1cyclictest65850irq/126-lan22:45:190
6559991817,1cyclictest65850irq/126-lan20:40:110
6559991817,1cyclictest65850irq/126-lan20:25:130
6559991817,1cyclictest65850irq/126-lan19:52:420
6559991817,1cyclictest65850irq/126-lan00:12:330
6559991716,1cyclictest65850irq/126-lan23:40:170
6559991716,1cyclictest65850irq/126-lan21:48:250
6559991716,1cyclictest65850irq/126-lan21:48:250
6559991716,1cyclictest65850irq/126-lan21:00:180
6559991716,1cyclictest65850irq/126-lan20:30:170
6559991716,1cyclictest65850irq/126-lan20:03:440
6559991716,1cyclictest65850irq/126-lan19:45:120
6559991716,1cyclictest65850irq/126-lan19:15:170
6559991716,1cyclictest65850irq/126-lan00:25:220
6559991716,1cyclictest65850irq/126-lan00:24:320
6559991616,0cyclictest65850irq/126-lan23:05:280
6559991616,0cyclictest65850irq/126-lan22:54:320
6559991616,0cyclictest65850irq/126-lan22:15:110
6559991616,0cyclictest65850irq/126-lan00:16:320
6559991615,1cyclictest65850irq/126-lan23:35:130
6559991615,1cyclictest65850irq/126-lan23:15:120
6559991615,1cyclictest65850irq/126-lan23:00:130
6559991615,1cyclictest65850irq/126-lan22:30:200
6559991615,1cyclictest65850irq/126-lan22:10:190
6559991615,1cyclictest65850irq/126-lan22:00:190
6559991615,1cyclictest65850irq/126-lan20:50:110
6559991615,1cyclictest65850irq/126-lan20:10:180
6559991615,1cyclictest65850irq/126-lan19:10:200
6559991515,0cyclictest65850irq/126-lan23:55:100
6559991515,0cyclictest65850irq/126-lan22:55:080
6559991515,0cyclictest65850irq/126-lan22:05:160
6559991515,0cyclictest65850irq/126-lan21:28:260
6559991515,0cyclictest65850irq/126-lan19:25:190
6559991514,1cyclictest65850irq/126-lan23:45:120
6559991514,1cyclictest65850irq/126-lan21:21:000
6559991514,1cyclictest65850irq/126-lan21:08:310
6559991514,1cyclictest65850irq/126-lan20:55:000
6559991514,1cyclictest65850irq/126-lan20:20:110
6559991514,1cyclictest65850irq/126-lan19:40:150
6559991514,1cyclictest65850irq/126-lan19:30:140
6559991514,1cyclictest65850irq/126-lan00:35:150
6559991414,0cyclictest65850irq/126-lan22:39:320
6559991414,0cyclictest65850irq/126-lan21:40:110
6559991414,0cyclictest65850irq/126-lan19:22:290
6559991414,0cyclictest65850irq/126-lan00:05:120
6559991413,1cyclictest65850irq/126-lan21:59:120
6559991413,1cyclictest65850irq/126-lan21:35:190
6559991413,1cyclictest65850irq/126-lan20:46:330
6559991313,0cyclictest65850irq/126-lan21:50:120
6559991313,0cyclictest65850irq/126-lan20:19:330
6559991313,0cyclictest65850irq/126-lan00:03:330
6559991312,1cyclictest65850irq/126-lan22:40:120
6559991312,1cyclictest65850irq/126-lan22:25:200
6559991312,1cyclictest65850irq/126-lan21:15:170
6559991312,1cyclictest65850irq/126-lan00:30:140
6559991212,0cyclictest65850irq/126-lan21:12:310
6559991212,0cyclictest65850irq/126-lan20:35:110
6559991211,1cyclictest65850irq/126-lan23:50:120
6559991211,1cyclictest65850irq/126-lan23:10:170
6559991211,1cyclictest65850irq/126-lan22:23:310
6559991211,1cyclictest65850irq/126-lan21:30:180
656499118,3cyclictest741-21lldpd20:53:581
656499108,2cyclictest741-21lldpd20:56:461
656499107,3cyclictest743-21snmpd19:38:071
656499106,4cyclictest743-21snmpd22:28:101
656499103,7cyclictest5330-21grep00:20:131
6559991010,0cyclictest65850irq/126-lan23:29:320
65739998,1cyclictest741-21lldpd22:20:553
65689998,1cyclictest743-21snmpd21:44:142
65689998,1cyclictest743-21snmpd21:26:202
65689998,1cyclictest741-21lldpd23:08:262
65689998,1cyclictest741-21lldpd22:35:072
65649998,1cyclictest743-21snmpd22:43:101
65649998,1cyclictest743-21snmpd19:22:341
65649996,3cyclictest743-21snmpd21:40:441
65649996,3cyclictest743-21snmpd20:35:541
65649996,3cyclictest741-21lldpd19:45:411
65599998,1cyclictest65850irq/126-lan19:55:430
65599998,1cyclictest65850irq/126-lan19:35:170
65739988,0cyclictest743-21snmpd22:58:053
65739988,0cyclictest743-21snmpd22:46:113
65739988,0cyclictest743-21snmpd00:33:203
65739988,0cyclictest741-21lldpd21:41:303
65739988,0cyclictest741-21lldpd00:14:313
65739987,1cyclictest743-21snmpd23:28:273
65739987,1cyclictest743-21snmpd21:03:163
65739987,1cyclictest743-21snmpd20:52:493
65739987,1cyclictest522-21avahi-daemon20:17:323
65739986,2cyclictest743-21snmpd23:10:503
65739986,2cyclictest743-21snmpd23:00:323
65739986,2cyclictest743-21snmpd22:26:103
65739986,2cyclictest743-21snmpd21:19:533
65739986,2cyclictest743-21snmpd21:06:133
65739986,2cyclictest743-21snmpd19:44:353
65739986,2cyclictest743-21snmpd00:17:313
65689988,0cyclictest743-21snmpd21:50:382
65689988,0cyclictest743-21snmpd20:02:532
65689988,0cyclictest743-21snmpd00:27:192
65689988,0cyclictest741-21lldpd21:58:322
65689988,0cyclictest741-21lldpd00:24:522
65689987,1cyclictest743-21snmpd23:59:362
65689987,1cyclictest743-21snmpd23:30:422
65689987,1cyclictest743-21snmpd22:09:332
65689987,1cyclictest741-21lldpd19:15:222
65689986,2cyclictest743-21snmpd23:02:262
65689986,2cyclictest743-21snmpd22:28:402
65689986,2cyclictest743-21snmpd22:24:092
65689986,2cyclictest743-21snmpd19:43:302
65689986,2cyclictest743-21snmpd19:20:222
65649988,0cyclictest743-21snmpd22:09:241
65649988,0cyclictest743-21snmpd21:30:361
65649988,0cyclictest741-21lldpd23:20:381
65649987,1cyclictest741-21lldpd23:19:371
65649986,2cyclictest741-21lldpd00:11:171
65649986,2cyclictest522-21avahi-daemon21:48:551
65649986,2cyclictest522-21avahi-daemon21:48:541
65649985,3cyclictest743-21snmpd20:09:261
65649985,3cyclictest741-21lldpd00:00:211
65649985,3cyclictest26601-21cpuspeed_turbos21:15:131
65649984,4cyclictest743-21snmpd20:14:181
65649984,4cyclictest2897-21grep22:55:111
65649982,3cyclictest25696-21sed22:30:211
65649982,3cyclictest24546-21seq19:53:471
65649982,3cyclictest18335-21seq23:33:151
65649982,2cyclictest3005-21sed20:20:121
65649982,2cyclictest15125-21sort23:25:141
65649980,5cyclictest23600-21ntpq23:45:161
65649980,4cyclictest7791-21ntpq00:25:171
65649980,3cyclictest21528-21/usr/sbin/munin23:40:131
65649980,3cyclictest11189-21ntp_states21:55:191
65649980,2cyclictest22343-21sort21:05:121
65599987,1cyclictest743-21snmpd23:32:000
65739977,0cyclictest743-21snmpd23:53:473
65739977,0cyclictest743-21snmpd22:04:213
65739977,0cyclictest743-21snmpd19:50:143
65739977,0cyclictest743-21snmpd19:47:353
65739977,0cyclictest743-21snmpd00:28:043
65739977,0cyclictest741-21lldpd20:45:143
65739977,0cyclictest741-21lldpd20:22:493
65739977,0cyclictest741-21lldpd00:09:253
65739976,1cyclictest743-21snmpd20:33:153
65739976,1cyclictest743-21snmpd20:27:253
65739976,1cyclictest743-21snmpd20:01:143
65739976,1cyclictest522-21avahi-daemon22:13:473
65739976,1cyclictest522-21avahi-daemon22:05:323
65739975,2cyclictest743-21snmpd23:42:033
65739975,2cyclictest743-21snmpd21:57:153
65739975,2cyclictest743-21snmpd21:11:143
65739975,2cyclictest743-21snmpd19:35:073
65739975,2cyclictest27248-21cat23:55:143
65689977,0cyclictest743-21snmpd23:21:472
65689977,0cyclictest743-21snmpd20:33:422
65689977,0cyclictest743-21snmpd19:56:272
65689977,0cyclictest743-21snmpd00:05:062
65689977,0cyclictest741-21lldpd22:40:462
65689977,0cyclictest741-21lldpd21:09:382
65689977,0cyclictest522-21avahi-daemon20:41:212
65689976,1cyclictest743-21snmpd23:45:062
65689976,1cyclictest743-21snmpd22:34:252
65689976,1cyclictest743-21snmpd21:24:352
65689976,1cyclictest741-21lldpd21:35:182
65689976,1cyclictest6820-21cpuspeed_turbos19:10:122
65689976,1cyclictest522-21avahi-daemon23:51:432
65689976,1cyclictest522-21avahi-daemon21:47:012
65689976,1cyclictest522-21avahi-daemon21:47:002
65689976,1cyclictest31030-21cpuspeed_turbos22:45:132
65689975,2cyclictest743-21snmpd23:18:082
65689975,2cyclictest743-21snmpd00:34:352
65689975,2cyclictest12308-21cat00:35:132
65689973,3cyclictest23198-21fw_forwarded_lo19:50:122
65649977,0cyclictest743-21snmpd20:46:401
65649977,0cyclictest743-21snmpd00:18:131
65649976,1cyclictest27131-21fschecks_count20:00:121
65649975,2cyclictest743-21snmpd23:55:061
65649975,2cyclictest741-21lldpd21:00:111
65649975,2cyclictest18753-21tail22:15:121
65649974,3cyclictest743-21snmpd20:15:061
65649973,3cyclictest24680-21diskstats21:10:121
65649972,2cyclictest24896-21find19:55:131
65649971,3cyclictest8945-21cat23:10:121
65649971,2cyclictest557-21NetworkManager19:25:051
65649971,2cyclictest5073-21grep20:25:111
65649970,4cyclictest31665-21ntpq00:05:181
65649970,4cyclictest25604-21ntpq23:50:151
65649970,4cyclictest13108-21ntpq22:00:161
65649970,3cyclictest9743-21fw_packets00:30:141
65649970,3cyclictest8876-21/usr/sbin/munin21:50:131
65649970,3cyclictest866-21fw_conntrack22:50:121
65649970,3cyclictest7085-21/usr/sbin/munin19:10:131
65649970,3cyclictest5527-21grep23:00:191
65649970,3cyclictest31208-21grep21:25:161
65649970,3cyclictest31124-21/usr/sbin/munin22:45:131
65649970,3cyclictest29702-21/usr/sbin/munin21:20:201
65649970,3cyclictest19548-21cut19:40:161
65649970,3cyclictest18843-21expr23:35:101
65649970,3cyclictest16563-21diskstats22:10:121
65649970,3cyclictest15523-21/usr/sbin/munin19:30:151
65649970,3cyclictest11543-21idleruntime20:40:141
65649970,2cyclictest9992-21/usr/sbin/munin19:15:201
65649970,2cyclictest7535-21if_lan20:30:161
65649970,2cyclictest2421-21/usr/sbin/munin21:35:121
65649970,2cyclictest12399-21latency00:35:141
65739966,0cyclictest522-21avahi-daemon23:33:343
65739966,0cyclictest522-21avahi-daemon21:22:333
65739966,0cyclictest522-21avahi-daemon19:11:413
65739965,1cyclictest12890-21cpuspeed_turbos19:25:143
65739964,2cyclictest743-21snmpd19:15:073
65739964,2cyclictest1006-21cat22:50:133
65689966,0cyclictest743-21snmpd20:56:192
65689966,0cyclictest741-21lldpd19:47:592
65689966,0cyclictest741-21lldpd19:25:322
65689966,0cyclictest522-21avahi-daemon20:22:422
65689965,1cyclictest8727-21cpuspeed_turbos23:10:122
65689965,1cyclictest743-21snmpd23:43:142
65689965,1cyclictest743-21snmpd20:54:432
65689964,2cyclictest743-21snmpd19:31:132
65689962,3cyclictest6309-21sed20:25:212
65689962,3cyclictest30176-21awk00:00:212
65689962,3cyclictest1150-21memory20:15:142
65649960,3cyclictest26545-21apt-config22:35:001
65649960,3cyclictest20613-21diskstats22:20:121
65649960,2cyclictest6802-21df_inode23:05:121
65739955,0cyclictest743-21snmpd23:39:293
65739955,0cyclictest741-21lldpd23:06:443
65739955,0cyclictest741-21lldpd22:43:143
65739954,1cyclictest743-21snmpd23:20:073
65739954,1cyclictest18703-21gltestperf22:15:113
65739954,1cyclictest17608-21cat20:55:143
65739953,2cyclictest25266-21head19:55:153
65739952,3cyclictest2889-21sed21:35:153
65739952,2cyclictest8517-21grep21:50:113
65739952,2cyclictest31435-21uname21:25:183
65739952,2cyclictest28984-21tr00:00:113
65739952,2cyclictest27225-21grep22:35:123
65739952,2cyclictest244-20systemd-journal20:09:083
65739952,2cyclictest12065-21pmu-power20:40:193
65689955,0cyclictest522-21avahi-daemon22:58:382
65689955,0cyclictest522-21avahi-daemon21:18:502
65689955,0cyclictest522-21avahi-daemon19:38:382
65689953,2cyclictest743-21snmpd20:10:092
65689952,3cyclictest1453-21nvmesmart_nvme022:50:162
65689952,2cyclictest9297-21grep20:35:132
65689952,2cyclictest1583-21awk21:30:212
65689952,2cyclictest14440-21unixbench_multi20:45:212
65689952,2cyclictest13830-21sshd22:01:322
65689951,3cyclictest19258-21ntp_states22:15:162
65689950,4cyclictest17253-21ntpq22:10:192
65739944,0cyclictest741-21lldpd21:48:523
65739944,0cyclictest741-21lldpd21:48:513
65739943,1cyclictest11563-21ntpq19:20:163
65739942,2cyclictest743-21snmpd23:49:513
65739942,2cyclictest11950-21cat00:35:113
65739941,2cyclictest9186-21sort20:35:113
65739941,2cyclictest905-21strings21:30:153
65739941,2cyclictest5888-21pmu-power00:20:163
65739941,2cyclictest15977-21wc19:30:203
65739941,2cyclictest11306-21needreboot23:15:153
65739940,3cyclictest31672-21ntp_192.168.11420:10:163
65739940,3cyclictest24767-21fw_packets22:30:123
65689942,2cyclictest557-21NetworkManager00:10:122
65689942,2cyclictest19850-21grep21:00:122
65689942,2cyclictest19286-21sed23:35:132
65689941,2cyclictest3663-21sh00:15:172
65689941,2cyclictest15387-21strings23:25:152
65689940,3cyclictest28960-21/usr/sbin/munin20:05:102
65689940,3cyclictest23827-21apt-get21:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional