Unix Technical Forum

SEO

vBulletin Search Engine Optimization


Go Back   Unix Technical Forum > Unix Operating Systems > Linux Operating System

Register FAQ Members List Calendar Search Today's Posts Mark Forums Read
  #1 (permalink)  
Old 01-17-2008, 04:41 PM
2boxers_at_comcast_dot_net
 
Posts: n/a
Default FTP over PPP stalls out

Maybe somebody else has experienced similar problems and can make
suggestions that pertain to what is happening to me.

I was running Mandrake 9. The system basically performed flawlessly.
I was able to PPP with a modem from the linux box, ftp over that
connection, as well as set up the linux box to be an IPTABLES NAT so
that workstations on the network could have Internet connectivity as
well. The modem line was a backup to the Cable Modem interface, which
also worked well under Mandrake.

I recently installed RH9 on this pc. I did this because I bought a
new RAID5 controller (S150SX4) from promise and it has specific kernel
requirements- one of them being 2.4.20-8 or 2.4.20-8smp. The
controller card is working fine and performance is acceptable.

Here is the problem:
PPP is performing poorly. There are 10 - 20% RX errors as well as 10
- 20% packet loss with simple pings.

This very same modem and phoneline when plugged into a system running
Windows XP performs fine.

This very same modem and phoneline also performed fine with the
previous Mandrake configuration .

Regardless of connect speeds which are either 28800 or 49333,
depending on whether or not I enable V90, I get 1.4 - 1.6KB/sec avg
speed over FTP. Note: this is a USR Courier V.everything modem.

I used to get over 4k on average with bursts of 5-6KB/sec.

With the packet loss and RX errors, needless to say, this PPP
interface is worthless as a NAT.

Here is my system:
Dual P2 400's. (Not a powerhouse, but it has been reliable for a
couple years now)
1GB pc-133 RAM
400GB RAID5
Intel Gigabit Ethernet
3Com 10/100 Ethernet
Adaptec 2940 w/Tandberg SLR5 tapedrive and NEC Cd-Rom
Panasonic IDE Cd-Rom
USR Courier v.everything modem

RH9
kernel-2.4.20-8smp
iptables v1.2.7a

So far I have tried:
connecting to a different ISP
using a different modem
lowering baud rates and line speeds
verified correct modem init string
asyncmap 0

None of this made much of a difference if at all.

During FTP transfers, both CPUs are virtually idle. 2-3% intermittent
utilization and yet the ftp performance is poor.

I tried using mru 576 and mtu 576 and there was a slight throughput
improvement. 1.9KB/sec, but nothing great. Packet loss and RX errors
still were at 10-20%.

Also, with mru and mtu at 576, workstations fail to transfer through
the NAT. It seems that the minimum that works over the NAT is 1500.

Can somebody suggest some things to test to help narrow down this
problem?

Thanks in advance,
Charles
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #2 (permalink)  
Old 01-17-2008, 04:41 PM
Jim Fischer
 
Posts: n/a
Default Re: FTP over PPP stalls out

2boxers_at_comcast_dot_net wrote:
> Maybe somebody else has experienced similar problems and can make
> suggestions that pertain to what is happening to me.
>
> I was running Mandrake 9. The system basically performed flawlessly.
> I was able to PPP with a modem from the linux box, ftp over that
> connection, as well as set up the linux box to be an IPTABLES NAT so
> that workstations on the network could have Internet connectivity as
> well. The modem line was a backup to the Cable Modem interface, which
> also worked well under Mandrake.
>
> I recently installed RH9 on this pc. I did this because I bought a
> new RAID5 controller (S150SX4) from promise and it has specific kernel
> requirements- one of them being 2.4.20-8 or 2.4.20-8smp. The
> controller card is working fine and performance is acceptable.
>
> Here is the problem:
> PPP is performing poorly. There are 10 - 20% RX errors as well as 10
> - 20% packet loss with simple pings.
>
> This very same modem and phoneline when plugged into a system running
> Windows XP performs fine.
>
> This very same modem and phoneline also performed fine with the
> previous Mandrake configuration .
>
> Regardless of connect speeds which are either 28800 or 49333,
> depending on whether or not I enable V90, I get 1.4 - 1.6KB/sec avg
> speed over FTP. Note: this is a USR Courier V.everything modem.
>
> I used to get over 4k on average with bursts of 5-6KB/sec.
>
> With the packet loss and RX errors, needless to say, this PPP
> interface is worthless as a NAT.
>
> Here is my system:
> Dual P2 400's. (Not a powerhouse, but it has been reliable for a
> couple years now)
> 1GB pc-133 RAM
> 400GB RAID5
> Intel Gigabit Ethernet
> 3Com 10/100 Ethernet
> Adaptec 2940 w/Tandberg SLR5 tapedrive and NEC Cd-Rom
> Panasonic IDE Cd-Rom
> USR Courier v.everything modem
>
> RH9
> kernel-2.4.20-8smp
> iptables v1.2.7a
>
> So far I have tried:
> connecting to a different ISP
> using a different modem
> lowering baud rates and line speeds
> verified correct modem init string
> asyncmap 0
>
> None of this made much of a difference if at all.
>
> During FTP transfers, both CPUs are virtually idle. 2-3% intermittent
> utilization and yet the ftp performance is poor.
>
> I tried using mru 576 and mtu 576 and there was a slight throughput
> improvement. 1.9KB/sec, but nothing great. Packet loss and RX errors
> still were at 10-20%.
>
> Also, with mru and mtu at 576, workstations fail to transfer through
> the NAT. It seems that the minimum that works over the NAT is 1500.
>
> Can somebody suggest some things to test to help narrow down this
> problem?
>
> Thanks in advance,
> Charles


Here are some comments / suggestions:

*) Various people have reported poor performance issues with various FTP
programs (clients and/or servers) on various releases of <pick your
favorite Linux distro>. So you might want to run some "Google Groups"
searches on the Linux/Redhat newsgroups using keywords like "poor ftp
performance" to see if you can locate some of these message threads.
(
http://www.google.com/advanced_group_search
Newsgroups: *linux* *redhat*
)

*) Even though the manufacturer of your RAID5 controller states that the
"required" kernel version as '2.4.20-8', chances are that other kernel
versions - and particularly later kernel versions - will work as good
as, or even better than, the 2.4.20-8 release.

*) Multiple RH9 Linux 'kernel' RPMs can be installed on a single system
at the same time, giving you the option to boot the computer into one of
several different kernel versions. So you might consider downloading and
installing the latest 'update' release of the RH9 'kernel' RPM.
(ftp://ftp.redhat.com/pub/redhat/linux/updates/9/en/os)

*) The Linux kernels that Red Hat provides contain Red Hat-specific
"fixes" in the kernel code. So you might want to try downloading,
building, and installing a stock Linux 2.4.20 (or later) kernel - i.e.,
a kernel that hasn't been "fixed" by Red Hat - to see if a stock kernel
works better. (http://www.kernel.org)

*) The 'netfilter' firewall software (in the Linux kernel) has some
kernel modules that provide protocol-specific support for connection
tracking (ip_conntrack_*) and NAT (ip_nat_*). FTP is one of the
protocols that requires these special connection tracking and NAT kernel
modules - i.e., 'ip_conntrack_ftp' and 'ip_nat_ftp', respectively.

[root]# modprobe ip_conntrack_ftp
[root]# modprobe ip_nat_ftp
[root]# lsmod | grep ^ip | sort
[root]# find /lib/modules/ -name "ip_conntrack*"
[root]# find /lib/modules/ -name "ip_nat_*"

*) Are you using the latest-and-greatest release of the 'ppp' RPM? FWIW,
here's the version that's currently installed on my RH9 Linux box:

[root]# rpm -q ppp
ppp-2.4.1-10

(n.b. I don't use PPP. So I can't offer any advice as to whether this is
a stable/good release of the 'ppp' RPM or not.)

FWIW, if the 'Fedora Core 1' distro has a newer version/release of the
'ppp' RPM, you might consider downloading and then building the *SOURCE*
RPM (SRPM) (.src.rpm) for the new release. You should be able to find
the 'ppp' SRPM on Red Hat's FTP site (which seems to be off line today,
along with Red Hat's web server <?>).

--
Jim

To reply by email, remove "link" and change "now.here" to "yahoo"
jfischer_link5809{at}now.here.com


Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #3 (permalink)  
Old 01-17-2008, 04:41 PM
2boxers_at_comcast_dot_net
 
Posts: n/a
Default Re: FTP over PPP stalls out

On Fri, 14 Nov 2003 12:55:00 -0600, Jim Fischer
<jfischer_link5809@now.here.com> wrote:

>
>Here are some comments / suggestions:
>
>*) Various people have reported poor performance issues with various FTP
>programs (clients and/or servers) on various releases of <pick your
>favorite Linux distro>. So you might want to run some "Google Groups"
>searches on the Linux/Redhat newsgroups using keywords like "poor ftp
>performance" to see if you can locate some of these message threads.
>(
>http://www.google.com/advanced_group_search
>Newsgroups: *linux* *redhat*
>)


I have been doing this for the past few days. My problem is most
noticeable using FTP since FTP uses all available bandwidth, but a
simple ping also reveals the 10-20% packet loss, so an FTP specific
solution may not be in order. I could have picked a better subject
header, but it seems that many people are having this problem with
redhat 9.

>
>*) Even though the manufacturer of your RAID5 controller states that the
>"required" kernel version as '2.4.20-8', chances are that other kernel
>versions - and particularly later kernel versions - will work as good
>as, or even better than, the 2.4.20-8 release.


You would think so.

Actually, this device has very specific kernel support, unfortunately.
There has been talk of a partial source release of the driver which
would allow building the driver as a module or as part of a kernel,
but as of now, the driver is installed, prebuilt for specific kernels
only. This is a growing concern as there may be reasons that require
building a new kernel.

http://www.promise.com/support/downl...y=All&os=10 0

Promise really needs to get on the ball with Linux support.

>
>*) Multiple RH9 Linux 'kernel' RPMs can be installed on a single system
>at the same time, giving you the option to boot the computer into one of
>several different kernel versions. So you might consider downloading and
>installing the latest 'update' release of the RH9 'kernel' RPM.
>(ftp://ftp.redhat.com/pub/redhat/linux/updates/9/en/os)


Yes I know, I had 8 or 9 or so on my Mandrake system, Long live
lilo... but this doesnt help me in this case unless there are options
that I need to add or remove from my existing kernel version to fix
ppp.

>
>*) The Linux kernels that Red Hat provides contain Red Hat-specific
>"fixes" in the kernel code. So you might want to try downloading,
>building, and installing a stock Linux 2.4.20 (or later) kernel - i.e.,
>a kernel that hasn't been "fixed" by Red Hat - to see if a stock kernel
>works better. (http://www.kernel.org)
>


I would much rather use a plain vanilla kernel, but as of right now I
don't have the choice as explained above.

This is liable to be the fix, but unfortunately I cannot employ this
since the controller driver is forcing me to use a specific kernel.

I know better than to buy another one of these controllers for this
reason, but for now, all seems to be working well with the controller
itself and I need the storage capacity it is providing.

>*) The 'netfilter' firewall software (in the Linux kernel) has some
>kernel modules that provide protocol-specific support for connection
>tracking (ip_conntrack_*) and NAT (ip_nat_*). FTP is one of the
>protocols that requires these special connection tracking and NAT kernel
>modules - i.e., 'ip_conntrack_ftp' and 'ip_nat_ftp', respectively.
>
> [root]# modprobe ip_conntrack_ftp
> [root]# modprobe ip_nat_ftp
> [root]# lsmod | grep ^ip | sort
> [root]# find /lib/modules/ -name "ip_conntrack*"
> [root]# find /lib/modules/ -name "ip_nat_*"
>


I have never had to use the protocol specific modules before, but I do
not question you. I know they are there for a reason.

Additionally, I have the problem without iptables loaded. In other
words, PPP only from the linux box, ftp client from the linux box over
that ppp connection produces the poor performance.

>*) Are you using the latest-and-greatest release of the 'ppp' RPM? FWIW,
>here's the version that's currently installed on my RH9 Linux box:
>
> [root]# rpm -q ppp
> ppp-2.4.1-10
>


This is what I have installed.

>(n.b. I don't use PPP. So I can't offer any advice as to whether this is
>a stable/good release of the 'ppp' RPM or not.)
>
>FWIW, if the 'Fedora Core 1' distro has a newer version/release of the
>'ppp' RPM, you might consider downloading and then building the *SOURCE*
>RPM (SRPM) (.src.rpm) for the new release. You should be able to find
>the 'ppp' SRPM on Red Hat's FTP site (which seems to be off line today,
>along with Red Hat's web server <?>).


Building the latest PPP may not be a bad idea. It wouldnt be the
first time I have fixed smp related problems by building new binaries.

Any idea if pppd has any smp specific support or properties?

If this were a kernel specific problem, what methods are there for
diagnosing poor ppp performance aside from replacing the kernel?

How can I check if the IRQ's are being serviced properly?

How can I check if the pppd process is being serviced properly?

Charles
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #4 (permalink)  
Old 01-17-2008, 04:41 PM
Andy Furniss
 
Posts: n/a
Default Re: FTP over PPP stalls out

no name wrote:

> Maybe somebody else has experienced similar problems and can make
> suggestions that pertain to what is happening to me.
>
> I was running Mandrake 9. The system basically performed flawlessly.
> I was able to PPP with a modem from the linux box, ftp over that
> connection, as well as set up the linux box to be an IPTABLES NAT so
> that workstations on the network could have Internet connectivity as
> well. The modem line was a backup to the Cable Modem interface, which
> also worked well under Mandrake.
>
> I recently installed RH9 on this pc. I did this because I bought a
> new RAID5 controller (S150SX4) from promise and it has specific kernel
> requirements- one of them being 2.4.20-8 or 2.4.20-8smp. The
> controller card is working fine and performance is acceptable.
>
> Here is the problem:
> PPP is performing poorly. There are 10 - 20% RX errors as well as 10
> - 20% packet loss with simple pings.


Maybe your com port is getting serial overruns because the new card is
causing lots of higher priority interrupts.

I used to be able to make any ppp on com grind to a halt by scp-ing
from/flood pinging my gateway - doesn't happen now I've got a PCI DSL modem
on the same set up. I didn't fix it, but assumed it was because the IRQ on
the com was too low.

You can change this with irqtune.

Andy.


Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #5 (permalink)  
Old 01-17-2008, 04:41 PM
2boxers_at_comcast_dot_net
 
Posts: n/a
Default Re: FTP over PPP stalls out

>Maybe your com port is getting serial overruns because the new card is
>causing lots of higher priority interrupts.
>
>I used to be able to make any ppp on com grind to a halt by scp-ing
>from/flood pinging my gateway - doesn't happen now I've got a PCI DSL modem
>on the same set up. I didn't fix it, but assumed it was because the IRQ on
>the com was too low.
>
>You can change this with irqtune.

Does this even work with 2.4.x SMP kernels with APIC enabled?
Charles
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #6 (permalink)  
Old 01-17-2008, 04:41 PM
Andy Furniss
 
Posts: n/a
Default Re: FTP over PPP stalls out

no name wrote:

> >Maybe your com port is getting serial overruns because the new card is
> >causing lots of higher priority interrupts.
> >
> >I used to be able to make any ppp on com grind to a halt by scp-ing
> >from/flood pinging my gateway - doesn't happen now I've got a PCI DSL
> >modem on the same set up. I didn't fix it, but assumed it was because the
> >IRQ on the com was too low.
> >
> >You can change this with irqtune.

> Does this even work with 2.4.x SMP kernels with APIC enabled?
> Charles


I haven't got a clue, if it were me I would just try and see - but then you
may have more to loose if it all goes pear shaped :-)

Andy.

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #7 (permalink)  
Old 01-17-2008, 04:42 PM
2boxers_at_comcast_dot_net
 
Posts: n/a
Default Re: FTP over PPP stalls out

Problem Solved !!!

I shut off the irqbalance service.

I adjusted the IRQ affinity for the serial port that the PPP modem was
connected to.

echo 2 > /proc/irq/4/smp_affinity

more about it here:
http://www.spoonix.com/howtos/smp_affinity.txt

When I did this, I immediately noticed a dramatic change for the
better.

By moving IRQ 4 to the second CPU, the performance was restored to
PPP.

I really dont know if it was IRQ contention or load on CPU 1, but even
with all the nics and controllers on CPU 2 with the serial port, the
performance increase was noticeable.

For good measure, I put everything but that serial port on CPU 1. Of
course individual processes can still interrupt either processor, but
it seems like it is fixed now.

RX errors are down to about 2% from 20%.
Downloads are up to 5.8 KB/sec from 1.5 KB/sec.

I notice in this configuration about 10% more CPU load to the second
processor and I take that as a good thing.

Additionally, something I didn't even have in my old configuration was
disabling MNP5 compression. This was a minor gain, but nevertheless
when we are talking kilobytes, I'll take what I can get.

Charles
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Reply


Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On
Forum Jump


All times are GMT. The time now is 09:35 PM.


Powered by vBulletin® Version 3.6.5
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
SEO by vBSEO 3.2.0
UnixAdminTalk.com

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708